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To David Russell Logan 


Preface to the Third Edition 


This new edition remains in step with the goals of earlier editions, namely, 
to offer a concise treatment of basic topics covered in a post-calculus differ- 
ential equations course. It is written for students in engineering, biosciences, 
physics, economics, and mathematics. As such, the text is strongly guided by 
applications in those areas. 

The last twenty-five years witnessed dramatic changes in basic calculus 
courses and in differential equations. One driver of change has been the avail- 
ability of technology and its role in a standard course, and another is the level 
of preparation of students with regard to their ability to perform analytical 
manipulations. Writing a text for such a diverse audience poses a substantial 
challenge. Some students need only know what a differential equation means 
and what it implies qualitatively to understand concepts in their areas; others, 
who plan on taking advanced courses in engineering or the physical sciences 
where the mathematics is more intense, require the ability to perform analytic 
calculations. This text makes an effort to balance these two issues. 

Some outstanding textbooks have been written for this course. Many are 
calculus-like and voluminous, with extensive graphics, marginal notes, and 
numerous examples and exercises; they cover many more topics than can be 
discussed in a one-semester course. I have often felt that students become over- 
whelmed, distracted, and even insecure about skipping material and jumping 
around in a text of several hundred pages. 

An overarching philosophy in this text is that you can’t cover everything. 
Therefore, it is more concise and written in a plain, user friendly format that 
is accessible to science and engineering students. Often these students have 
limited time and they appreciate a smaller parcel where it is clear what they 
should know. One success of the text has been that it gives instructors who want 
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this type of coverage an alternative to existing texts. Another characteristic is 
that it encourages students to begin developing their analytical thinking for 
future studies; this includes some formula manipulation and understanding of 
derivations. Students should slowly advance in their ability to read mathematics 
in preparation for more advanced, upper level texts in their areas, which require 
a lot of the reader. 

The topics are standard and the table of contents lists them in detail. Briefly, 
the chapter coverage is as follows. 


e Chapter 1. First-order equations. Separable, linear, and autonomous 
equations; equilibrium solutions, stability and bifurcation. Other special 
types of equations, for example, Bernoulli, exact, and homogeneous equa- 
tions, are covered in the Exercises with generous guidance. Many applica- 
tions are discussed from science, engineering, economics, and biology. 


e Chapter 2. Second-order linear equations. The emphasis is on equa- 
tions with constant coefficients, both homogeneous and nonhomogeneous, 
with most examples being spring-mass oscillators and electrical circuits. 
Other than Cauchy—Euler equations, variable coefficient equations are not 
examined in detail. There are three optional sections covering reduction of 
order, higher-order equations, and steady-state heat transfer, which deals 
with simple boundary value problems. 


e Chapter 3. Laplace transforms. The treatment is standard, but without 
overemphasizing partial fraction decompositions for inversion. Use of the 
enclosed table of transforms is encouraged. This chapter can be covered at 
any time after Chapter 2. 


e Chapter 4. Linear systems. This chapter deals only with two-dimensional, 
or planar, systems. It begins with a discussion of equivalence of linear sys- 
tems and second-order equations. Linear algebra is kept at a minimum 
level, with a very short introductory section on notation using vectors and 
matrices. General solutions are derived using eigenvalues and eigenvectors, 
and there are applications to chemical reactors (compartmental analysis), 
circuits, and other topics. There is a thorough introduction to phase plane 
analysis and simple geometric methods. 


e Chapter 5. Nonlinear systems. The content of this chapter focuses 
on applications, e.g., classical dynamics, circuits, epidemics, population 
ecology, chemical kinetics, malaria, and more. 


e Chapter 6. Computation of solutions. This brief chapter first dis- 


cusses the Picard iteration method, and then numerical methods. The lat- 
ter include the Euler and modified Euler methods, and the Runge-Kutta 
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method. All or parts of this chapter can be covered or referred to at any 
time during the course. 


A standard, one-semester course can be based on Chapter 1 through most 
of Chapter 4. 

This edition of the text incorporates many changes. Some topics have been 
rewritten and rearranged. I made the effort to introduce an easier-to-read for- 
mat and highlight important concepts. There is a increase in the number of 
routine examples and exercises. A major notational change is that generic func- 
tions in differential equations, previously represented by u = u(t), have been 
changed to the more common x = x(t). The number and variety of applica- 
tions is substantially increased, and several exercises throughout the book have 
enough substance to serve as mini-projects for students. Starred sections (*) are 
optional. Time availability in a one-semester course was an overriding factor, 
and some topics, such as power series and special functions, are not covered. 

Two appendices complement the chapters. There is a new appendix Review 
and Exercises that concisely summarizes methods from Chapters 1 and 2, and is 
supplemented with several exercises and solutions. It also includes a set of chap- 
ter exercises on which students can test their skills. A second appendix includes 
a MATLAB® supplement that summarizes MATLAB commands and demon- 
strates simple code writing, as well as use of its built-in programs and symbolic 
packages to solve problems in differential equations. MATLAB is not required 
for the text. Rather, students are encouraged to use the software available to 
them. Many exercises can be done with an advanced scientific calculator. Solu- 
tions to the even-numbered problems can be found at http: //www.springer.com/ 
and on the author’s web site. 

Several individuals deserve my heartfelt acknowledgments. User’s sugges- 
tions have become part of this revision, and I greatly appreciate their interest 
in making it a better text. Also I thank my many students who, over the last 
several years, have endured my lectures and exams and have generously given 
me valuable advice; very often they reminded me who my audience was. My son 
David, to whom I dedicate this book, was a frequent and meticulous grader who 
always advocated for students and often altered my own perspective in teaching 
undergraduates. Elizabeth Loew, my editor at Springer, deserves special recog- 
nition for her continuous attentiveness to the project and her expert support. 
I have found Springer to be an extraordinary partner in this project. 

Corrections, comments, and suggestions on the text are greatly appreciated. 
Contact information is on my web site: www.math.unl.edu/”jloganl. Additional 
material, including an errata, will be posted there. 


J. David Logan 
Willa Cather Professor 
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1 


First-Order Differential Equations 


Readers are familiar with solving algebraic equations. For example, the solu- 
tions to the quadratic equation 


si —2=0 
are easily found to be « = 0 and x = 1, which are numbers. An ordinary differ- 
ential equation, or just differential equation, is another type of equation where 
the unknown is not a number, but a function. We call the unknown function 
a(t) and think of it as a function of time t. Simply put, a differential equation 
is an equation that relates the unknown function to some of its derivatives, 
which, of course, are not known either. 

Why are differential equations so important that they deserve an entire 
course, or even lifetime, of study? Well, differential equations arise naturally 
as mathematical models in areas of science, engineering, economics, and many 
other subjects. Physical systems, biological systems, and economic systems, and 
so on are marked by change, or dynamics. Differential equations describe those 
dynamical changes. The unknown function x(t), often called the state function, 
could be the distance along a line, the current in an electrical circuit, the 
concentration of a chemical undergoing reaction, the population of an animal 
species in an ecosystem, or the demand for a commodity in a microeconomy. 
Differential equations represent laws that govern change, and the unknown 
state x(t), for which we solve, describes how the changes occur. The bottom line 
is that most laws of nature, and other systems, relate the rate, or derivative, at 
which some quantity changes to the quantity itself—thus a differential equation. 
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In this text we set up and solve differential equations. Often the solution to 
an equation is given by a general formula, and some may want to memorize the 
formulas. Students should realize that this strategy is inappropriate; it leads to 
little understanding and memorized formulas fade quickly from memory. What 
is important in this subject is conceptual; that is, the understanding of its 
origin and the process of solving the equation and interpreting the results. 

Historically, differential equations dates to the mid-seventeenth century 
when the calculus was developed by Isaac Newton (c. 1665) in the context 
of studying the laws of mechanics and the motion of planets (published in his 
Principia, 1687). In fact, some might say that calculus was invented to describe 
how objects move. Other famous mathematicians and scientists of that era, for 
example, Leibniz, the Bernoullis, Euler, Lagrange, and Laplace, contributed 
important results into the 1700s, and Cauchy developed some of the first theo- 
retical concepts in the 1800s. Differential equations is now the principal tool for 
applications in all areas of mechanics, thermodynamics, electromagnetic the- 
ory, quantum theory, and so on. It continues today with the study of dynamical 
systems and nonlinear phenomena in biology, chemistry, economics, and almost 
every area where the dynamics of systems is important. By studying differential 
equations, students are rewarded with a knowledge of one of the monuments 
of mathematics and science, and they see the great connection between nature 
and mathematics in ways that they may never have imagined. 


1.1 First-Order Equations 
1.1.1 Notation and Terminology 


We begin with a simple example from elementary physics. Suppose a body of 
mass m moves along a line with constant velocity V. Suddenly, say at time 
t = 0, an external resistive force F acts on the body given by F = —kv(t), 
where k > 0 is a fixed constant called the drag coefficient. So the force is 
proportional to the velocity for all times t > 0. Intuitively, the body will slow 
down and its velocity will decrease. From this information we can predict the 
velocity u(t) of the body at any time t > 0. Newton’s second law of motion 
states that the mass of the body times its acceleration equals the force upon 
it, or ma = F. We also know from calculus that the derivative of velocity is 
acceleration, or a = v’(t). (We are using the prime notation for derivative.) 
Therefore, Newton’s law implies 


mv’ (t) = —kv(t). 
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This is an example of a differential equation. The unknown is the velocity 
function v = v(t). We call it the equation of motion of the system. It involves 
an unknown function v(t), the velocity, and its derivative v’(t). If we can find 
a function v = v(t) that “works” in the equation and also satisfies v(0) = V, 
which is the initial condition on the velocity, then we will have determined 
the velocity of the particle at any time and solved the differential equation. In 
summary, we wish to solve for the velocity v = v(t) in the problem 


mv’ (t) = —kv(t), (1.1) 
(0) = V, (1.2) 


where m, k, and V are fixed parameters, or constants. 
After some practice we will be able to easily solve the equation and deter- 
mine that the velocity decreases exponentially, or 


v(t) = Ve“*/™, t>0. 


This formula for v(t) is the solution to the problem (1.1)—(1.2). To check that 
it works we substitute this expression into (1.1) and (1.2). 


mv’ (t) = mV (-£) e ht/m _ _x (verHie) = —kv(t). 
Moreover, substituting t = 0, we find v(0) = V. So it checks. 

To review, the differential equation (1.1) governs the dynamics of the body. 
We set it up using Newton’s second law, and it contains the unknown function 
u(t), along with its derivative v’(t). The solution u(t) predicts how the system 
evolves in time. We can sketch a generic graph of the solution as a visual 
representation of the motion. See Figure 1.1. 


Figure 1.1 A generic plot of the velocity v = v(t), a decreasing exponential, 
and the solution of (1.1)—(1.2). 
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In the previous example we used v = v(t) as the unknown velocity. But if 
the unknown is “population,” then we may use p = p(t) or N = N(t); if the 
unknown is current in a circuit, we may use I = I(t). To discuss differential 
equations in a generic setting with no specific context, we use x = x(t) as the 
unknown function. We think of x as the dependent variable and t, which is 
time, as the independent variable. Derivatives are denoted by a prime or by 
the Leibniz notation, 


dt’ 

and so on for higher derivatives. We use these notations interchangeably. Recall 
that the first derivative of a quantity is the “rate of change of the quantity,” 
measuring how fast the quantity is changing, and the second derivative mea- 
sures how fast the rate is changing. For example, if the state of a mechanical 
system is the position, then its first derivative is velocity and its second deriva- 
tive is acceleration, or the rate of change of velocity. 


A differential equation is an equation that relates the state of a system 
x(t) to some of its rates of change, as expressed by its derivatives x’ (t), x” (t), ..., 
and so on. In different words, it is an equation that describes how a state x(t) 
of a system changes in time. The common strategy in science, engineering, 
economics, and so on, is to formulate basic principles in terms of differential 
equations for the unknown state z = x(t) and then to solve the equation to 
find the state, thus determining how the system evolves in time. 

Because the time variable is understood, we often drop the time dependence 
notation in a differential equation and write, for example, the differential equa- 
tion (1.1) as 


mv’ =—kv or m—=-—kv. 
dt 

Example 1.1 
Here are four examples of differential equations that arise in various applica- 
tions: 

Ol + is sin@ = 0, (pendulum equation) 

, 1 . . . . 

Rq + GI= sin wt, (RC circuit equation) 

p =rp (1 — =) F (population equation) 

T’ =—-h(T — Q). (heating-cooling equation) 


The first equation models the angular deflections 0 = @(t) of a pendulum of 
length 1; the second models the charge q = q(t) on a capacitor in an electrical 
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circuit containing a resistor and a capacitor, where the current is driven by 
an electromotive force sinwt of frequency w. In the third equation, called the 
logistic equation, the unknown function p = p(t) represents the population of 
an animal species in a closed environment; r is the population growth rate and 
K represents the capacity of the environment to support the population. The 
last is Newton’s law of cooling, which models of temperature T = T(t) of an 
object placed in an environment of Q degrees; h is the heat loss coefficient. The 
unspecified constants in the various equations, 1, R, C, w, r, K, h, and Q are 
called parameters, and they can take any value we choose. Most differential 
equations that model physical processes contain such parameters. The constant 
g in the pendulum equation is a fixed parameter representing the acceleration 
of gravity on earth. In mks units, g = 9.8 meters per second squared. Because 
time-dependence is understood, in the first equation 6 means 6(t) and 6” means 
6’ (t), ete. 


The order of a differential equation is the order of the highest derivative 
appearing in the equation. For example, x’ + 2x = t is a first-order equation, 
and x” = —a’—7zx is a second-order equation. In Example 1.1, the first equation 
is second-order, and the the other three are first-order. 

To formulate general principles, we write a generic first-order equation for 
an unknown function « = x(t) as 


x’ = f(t,x), (1.3) 


where f represents some given functional relationship between t and x. This 
form is called the normal form of a first-order equation. A function x = x(t) 
is a solution! of (1.3) on a time interval I: a < t < b if it is differentiable on 
I and, when substituted into the equation, it satisfies the equation identically 
for every t € I; that is, 


a(t) = f(t,x(t)), for every t € I. 


“Satisfies identically’ means “can be reduced to 0 = 0.” To check if we have 
a solution, we merely substitute the function in question into the differential 
equation and check that it reduces to an identity. 

The problem of solving a differential equation with unknown x = z(t), 
subject to a condition x(tp) = xo, that is, 


eS f(t, x), 
x(to) = 20, 
' We are overburdening the notation by using the same symbol x to denote both a 


variable and a function. It would be more precise to write “x = y(t) is a solution,” 
but we choose to stick to the common use, and abuse, of a single letter. 
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is called an initial value problem (IVP). Here, to is a fixed value of time 
and 2 is a fixed value of x, and (to) = 2 is called an initial condition. 
Geometrically, an initial value problem asks what solution curve 1 = 2(t) 
plotted in the ta plane passes through the fixed point (to, 29). An example of 
an initial value problem is the problem (1.1)—(1.2) discussed at the beginning 
of this section. Later in Chapter 1 we state some very general conditions that 
guarantee that this problem has a solution. Finally, the interval of existence 
of an IVP is the largest time interval where the solution is valid. 


Example 1.2 


Consider the two similar [VPs 


The first has solution 


which exists for every value of t; the interval of existence is —co < t < oo. Yet 
the second has solution 
x(t) = tant, 


existing only on the interval —7/2 < t < 7/2, which is its interval of existence. 
(Any other branch of the tangent function will not pass through the point 
t = 0, « = 0.) Therefore, solutions to IVPs need not be valid for all times t. 


1.1.2 Growth—Decay Models 


In this section we present a very simple model of decay. Not only is the model 
an important application, but we use it here to introduce key ideas and termi- 
nology. We use these ideas and terms in almost every example in this book. 

Many processes in nature can be described as decay processes. For exam- 
ple, radioactive materials decay, ('4C, for example, in carbon dating), insect 
populations decay (mortality), chemicals released in the ground degrade over 
time, and drugs given by injection in the blood decay. These processes are all 
described by the decay equation 


gv =-ra, (decay equation) (1.4) 
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where r > 0 is the decay rate. Here, x = x(t), the state, represents some 
quantity of interest. In other words, the rate of change of the quantity is pro- 
portional to the amount present; —r denotes the proportionality constant and 
in the following discussion we assume it is a fixed number. Although it is easy 
to guess a solution to this equation, we want to solve it from basic principles. 
We rewrite the equation as 


eo 
and then observe from the chain rule that 
e — ue Ing 
x dt 
Thus the equation becomes 
FF Ing =-—r. 


Remembering that x is a function of t, we integrate both sides with respect to 


t to get : 
[ncaa [rae 
dt 


The integral of the derivative of a function is the function itself (integration 
and differentiation are inverse processes), and so we get 


Ing =—-rt+C, 


where C; is an arbitrary constant of integration. Solving for x gives 


= eo tttC1 _ ete Tt a Ce, 


where C is an arbitrary constant which can take on any value. (Note: if Cy is 
an arbitrary constant, then C = e@ must also be arbitrary.) Therefore, there 
are infinitely many solutions to the decay equation (1.4) given by 


eye”. (1.5) 


The infinite set of solutions (1.5) of a first-order equation is called the general 
solution of the equation. The general solution contains an arbitrary constant 
C’,, and as such it is also referred to as a one-parameter family of solutions— 
one for each choice of C. They are also referred to as the integral curves of 
the differential equation. These curves are plotted in Figure 1.2. 

One can ask how there can be infinitely many solutions to a decay problem. 
In a real system there is typically an initial condition imposed on the state 
x(t); that is, 

x(0) = 20, (initial condition) 

where Zo is a prescribed, fixed state at time t = 0. This initial condition picks 
out a specific value of the arbitrary constant C’, and hence a specific solution 
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Figure 1.2 (Left) Plots of four integral curves, or solution curves (1.5), of the 
differential equation (1.4), for four values of C. (Right) A particular solution 
satisfying the initial condition x(0) = a0. 


curve. In this case, (0) = % = Cexp(—r-0) = C. Therefore we have selected 
out a particular solution 


z(t) = aoe" 


of the DE (1.4). To repeat, of the many solutions, we have chosen the one that 
satisfies the initial condition. As we mentioned earlier, the problem of solving 
a differential equation subject to an initial condition is called an initial value 
problem. In the preceding discussion, the initial condition is given at t = 0, 
but in general it may be given at any fixed time t = to. 


Example 1.3 


(Radioactive decay) Four grams of a sample of a radioisotope decays to 
0.8 grams in 3 years. What is the decay constant r? What is the half-life, or 
the time when only half of the sample remains? If « = x(t) is the amount, in 
grams, of the isotope, the decay law is 


The general solution of the differential equation is 
at) = Ce. 


The initial condition (0) = 4 implies 2(0) = Ce~") = C = 4. Therefore, we 
have 
e(hieade-*, 
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After 3 years we have x(3) = 4e~3" = 0.8. Solving for r gives 


1 0.8 
r= -3 In (=) = 0.536 per year, 


which is the decay rate. To find the half life 7 we set 


a= 4eW9:5367 


Solving for 7 gives 7 = —(1/0.536) In0.5 = 1.293 years. 


Example 1.4 


(Population growth) Ecology is the study of how organisms interact with 
their environment. A fundamental problem in population ecology is to deter- 
mine what mechanisms operate to regulate animal populations. For the human 
population p = p(t), Thomas Malthus, an essayist in the late 1700s, proposed 


the model, or law, 

dp 
— =TP, 1.6 
EP (1.6) 
which states in words that the population growth rate p’ is proportional to the 
current population p. The proportionality constant r, given in dimensions of 


! (per time), is called the growth rate. We can regard r as depending on 


time 
births and deaths in the population; for example, r = b — m, where b is the 
birth rate and m is the mortality rate. This equation is solved exactly like the 


decay equation. The only difference is a minus sign. The general solution is 
p(t) = Ce™, 


where C is an arbitrary constant. If p(0) = Po is the initial population (where 
t = 0 is the time we begin counting), then C = Pp and the population grows 
exponentially according to 

p(t) = Poe™. 


As an aside, note that this is exactly the same law as for growth of money 
compounded continuously at interest rate r. 


EXERCISES 


1. Verify by direct substitution that the given differential equation has the 
solution as indicated. 


10 


10. 


11. 


1. First-Order Differential Equations 


a) cas, 2=t?. b) a =-4£, r=V6-??. 


Verify the solutions to the initial value problems in Example 1.2. 


Which of the following functions, 


is a solution to the DE a’ = —2?? 


Show that both 
ai(t)=e ‘cost and 22(t)=e 'sint 
are solutions to the second-order differential equation 
x” + 2a' +22 = 0. 


Show that 
z(t) = Ae~* sint + Be cost 


is a solution for any values of the constants A and B. 


Show that z(t) = In(t + C) is a one-parameter family of solutions, or 
integral curves, of x’ = e~*, where C is an arbitrary constant. Plot the 
integral curves using the values of C' given by C' = —2, —1, 0, 1, 2. On the 
plot indicate the particular solution that satisfying x(0) = 0. 


Find a solution x = x(t) of the equation x’ + 22 = t? + 4t+7 in the form 
of a quadratic function of t, that is, of the form x(t) = at? + bt + c, where 
a, b, and c are to be determined. 


Find values of m for which z(t) = t™ is a solution to 2ta’ = x. 


Find values of m for which a(t) = t™ is a solution to t?”” — 6x = 0. 


At 


Find two values of for which x(t) = e* is a solution of the differential 


equation 2x” — 52’ — 3x = 0. 


Show that the one-parameter family of straight lines x(t) = Ct + f(C) is 
a solution to the differential equation ta’ — 7 + f(x’) = 0 for any value of 
the constant C’. 


Plot the one-parameter family of curves x(t) = (t? — C)e* for different 
values of C. Find a differential equation whose solution is z = x(t). Hint: 
Find 2’ and then obtain a relation between t, x, and 2’. 


1.1 
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12. 


13. 


14. 


15. 


16. 


he. 


(Physics) In deep water, the intensity of light J = I(x) at a depth x meters 
below the water surface is modeled by the equation I’ = —1.47. At what 
depth is the light intensity 1% that at the surface? (Observe that x is the 
independent variable in this exercise.) 


(Carbon dating) The half-life of '4C (Carbon-14) is 5730 years. That is, it 
takes this many years for half of a sample of '4C to decay. If the decay of 
140 is modeled by x! = —rax, where x is the amount of 4C, find the decay 
constant r. (Answer: r = 0.000121 yr~*). In an artifact the percentage of 
the original '4C remaining at the present day was measured to be 20%. 
How old is the artifact? 


(Carbon dating) In 1950, charcoal from the Lascaux Cave in France gave an 
average count of 0.09 disintegrations of '4C (per minute per gram). Living 
wood gives 6.68 disintegrations. Estimate the date that individuals lived 
in the cave. Note: The amount of '4C is often measured in disintegrations 
per minute per gram. 


(Radioactivity) The half-life of radioactive cobalt is 5.3 years. After a 
nuclear reactor accident, the surrounding region had 100 times the amount 
of cobalt acceptable for habitation. How long will it be before the region is 
habitable? 


(Growth) The U.S. Census estimated that the world population was 6 bil- 
lion in 1999, and it was increasing 212,000 per day. What is the annual 
growth rate? At this rate, what is the predicted population of the world in 
2050? 


(Mortality) An insect population dies off exponentially and is governed by 
the equation p’ = —yp, where pu is the mortality rate. If 1000 insects hatch, 
and only 90 remain after 2 days, what is the mortality rate? 


1.1.3 Geometric Approach 


What does a differential equation x’ = f(t,x) tell us geometrically? At each 
fixed point (t,x) of the ta plane, the value of f(t,x) is the slope x’ of the 
solution curve x = x(t) that passes through that point. This is because 


a(t) = f(t, x(t). 


This simple fact suggests a useful graphical method for constructing approxi- 


mate solution curves for a first-order differential equation without finding the 


solution. Through each point of a selected set of points (t,x) in some region (or 
window) of the ta plane we draw a short line segment (dash) with slope f(t, z). 
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The collection of all these line segments, or mini-tangents, forms the direction 
field, or slope field, for the equation. We may then roughly sketch solution 
curves that fit into this direction field; the curves have the property that at 
each point the tangent line has the same slope as the slope of the direction 
field. 


Example 1.5 


The slope field for the differential equation 2’ = —x + 2t is defined by the right 
side of the differential equation, f(t, «) = —a + 2t. The slope field at the point 
(2,4) is f(2,4) = —4+2-2 = 0. This means the solution curve that passes 
through the point (2,4) has slope 0. Because it is tedious to calculate several 
mini-tangents, simple programs have been developed for advanced calculators 
and computer algebra systems that perform this task automatically. Figure 1.3 
shows a slope field and several solution curves that have been fit into the field. 
(The figure was easily created using MATLAB.) 


In most problems we do not need the detail shown in Figure 1.3; it is 
sufficient to know how to calculate the slope field at a few specially selected 
points (t, z). This gives the direction of the solution curves through those points. 
In particular, it is useful to find the set of all points in the plane where the 
slope field, or derivative, is either positive or negative and where it is zero 
(horizontal). 

The sets of points where the slope field is zero are called nullclines; these 
are especially of interest in problems because they indicate where the slope may 
change signs. Formally, the nullclines of the differential equation 2’ = f(t, x) 
is the set of points (t,2) for which f(t,2) = 0. The nullclines usually form a 
set of curves in the plane. In the regions between the nullclines, the slope field 
is positive or negative; it is often sufficient to select a point in each of those 
regions and calculate which. One alternative is to sketch the set of points (t, x) 
where the slope field has a constant value, that is, f(t,7) = k, for some fixed 
k. These curves are called isoclines. 


Example 1.6 


Consider the differential equation 


g =—ta+2* =2(r -t). 
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Figure 1.3 The slope field for the equation 2’ = —a + 2t in the window 


-1<t< 4, —4 < ax < 8, shown with several solution curves. If an initial 
condition x(to) = xo is imposed, then one solution curve is selected, the one 
passing through the point (to, xo). 


The nullclines, found by setting x’ = 0, are x = 0 (the ¢ axis) and the 
diagonal line x = t (both shown dashed in Figure 1.4). We note that 2’ > 0 
when x > Oandz >t,orz <Oandz <t. And, 2’ < Owhenz < Oandz >t, or 
x > Oand z < t. Slopes are sketched on the plot in the appropriate four regions 
separated by the nullclines. Using the directions we can sketch approximate 
solution curves as shown in Figure 1.4. The nullcline « = 0 indicates a line of 
horizontal tangents and in fact indicates a constant solution x(t) = 0 to the 
differential equation. 


Example 1.7 
The differential equation 
a’ = z(a7? —t) 


has nullclines « = 0 (the t-axis) and the parabolic curve x? = t, or « = +v4, 
xz = —Vt. Note that, as in the last example, z(t) = 0 is a solution to the 
equation. Where is the slope field positive? Negative? 


A problem in differential equations is just opposite of that in differential 
calculus. In calculus we know the function (curves) and are asked to find the 
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Figure 1.4 The slope field and nullclines « = 0, x = t (dashed) for the 
differential equation «’ = —ta + x?, with two approximate solution curves fit 
into the field. Note that the nullcline x = 0 is a solution to the DE, but x =t 
is not. 


derivative (slopes); in differential equations we know the slopes and try to find 
the functions, or curves, that fit the slopes. 


x 
< : ee 
ei a 
1 
t 
Figure 1.5 The two nullclines = 1, = 5 for the equation 2’ = 2 


(a —1)(5—2), both of which are constant solutions. Between the nullclines the 
slopes are positive and negative where indicated; approximate solution curves 
are indicated. 


There is simplicity in the slope field for a differential equation that has no 
explicit dependence on time, that is, 
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On each fixed horizontal line in the tz plane, where x has the same value, the 
slope field has the same value on that line. Moreover, the values of x where 
f(x) = 0 are constant solutions to the differential equation. 


Example 1.8 


Refer to Figure 1.5. Along the line « = 2 the equation x’ = 2(4—1)(5— 2) the 
slope field has value 6; so, every solution curve crossing that line has slope 6; this 
is an isocline. Along x = 3 the slope is 8, another isocline. For equations of this 
type, there are horizontal nullclines where x’ = f(a) = 0. Here, the nullclines 
are « = 1 and x = 5. It is important to notice that these horizontal nullclines 
define constant solutions x(t) = 1 and z(t) = 5 to the differential equation. 
These important solutions are called equilibrium solutions, or steady-states, 
because they do not change in time. Above the line = 5 and below the line 
x = 1 the slope field is negative, while in the region 1 < x < 5 the slope field 
is positive. We can sketch in a few approximate solution curves, as shown in 
Figure 1.5. This topic is discussed in detail in Section 1.5. 


EXERCISES 


1. By hand, sketch the slope field for the DE a’ = a2(1 — 2/4) in the window 
0<t<8,0< a2 < 8 at the integer lattice points. What is the value of 
the slope field along the lines « = 0 and x = 4? Show that x(t) = 0 and 
x(t) = 4 are constant solutions to the DE. 


2. Draw several isoclines of the differential equation x’ = x? + t?, and from 
your plots determine, approximately, the graphs of the solution curves. 


3. Draw the nullclines for the equation 2’ = 1 — 2. Graph the isoclines, or 
the locus of points in the plane where the slope field is equal to —3 and 
+3. 


4. Repeat Exercise 2 for the equation x’ = t— x”. Find the region in the plane 
where the slope field is positive and where it is negative. 


5. In the right-half ta plane (t > 0), plot the nullclines of the differential 
equation x’ = 2x?(x — 4\/t). Determine the sign of the slope field in the 
regions separated by the nullclines. Sketch the approximate solution curve 
passing through the point (1,4). Why can’t your curve cross the « = 0 
axis? 


6. Use software to sketch the slope field for the differential equation x’ = x?—-t 
on the square -3 <t<3,-3 <2 <3. 


16 1. First-Order Differential Equations 


1.2 Antiderivatives 


In calculus we face the problem of finding a function x = x(t) whose derivative 
is a given function g(t). This is the problem of finding the antiderivative 
x = x(t) of g(t). In the language of this text, we want to solve the differential 
equation 

x’ = g(t), (1.7) 
for the unknown x = «(t), where g(t) is a given continuous function. For exam- 
ple, if 

eg =t+1, 


then 


1 
x(t) = f+ nat= gf t#t+C, 


where C is an arbitrary constant of integration. This one-parameter family of 
curves are integral curves of the differential equation and represent the general 
solution. In general, we can use the indefinite integral notation and write the 
solution to (1.7) as 


x(t) = J stoae +C. (1.8) 


It is clear that the antiderivative is unique only up to an additive constant. 
We can select a unique antiderivative by imposing an initial condition of the 
form 


a(to) = 20. (1.9) 


In other words we want to find the antiderivative that passes through the 
specific point (to,2o) of the ta plane. This initial condition determines the 
arbitrary constant C in (1.8). The differential equation (1.8) along with (1.9) 
is an initial value problem. 


Example 1.9 


Find « = x(t) that satisfies the initial value problem 
ger =i, alo: (1.10) 
By direct integration, 
x(t) = f@-at+e= sf -t+0, 


where C' is an arbitrary constant. This is the general solution and it plots as 
a family of cubic curves in the ta plane, one curve for each value of C. A 
particular solution to the IVP is found by imposing the initial condition. It 
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selects out a specific value of the constant C’, and hence a specific curve. Here, 
a(1) = 2, which gives $(1)? — 1+ C = 2, or C = 8. Therefore, the solution to 
the initial value problem (1.10) is 


Example 1.10 


For equations of the form x’ = g(t) we can take two successive antiderivatives 
to find the general solution. Consider the DE 


a” =t+4+2. 


Then, integrating once, we get 
/ 1 2 
gz’ = at + 2t+ Cj. 


Integrating again, 


1 
L= gt te + Cit + Co. 


Here Cy and C2 are two arbitrary constants. For second-order equations we 
always expect two arbitrary constants, or a two-parameter family of solutions. It 
takes two initial conditions to determine the arbitrary constants. For example, 
if (0) = 1 and if 2’(0) = 0, then Cy = 0 and C, = 1, and we obtain the 
particular solution a(t) = 3¢2 +? +1. 


Consider another example. 


Example 1.11 


Solve the initial value problem on the interval t > 0: 


The general solution of the DE is 


a(t) = peta img 


But now we are stymied; there is no formula that gives an expression for the 
indefinite integral. Therefore, there is no way to use the initial condition to 
evaluate the constant of integration, or even evaluate the solution x(t) at a 
particular value of t. In fact, the indefinite integral [ e~' dt carries no infor- 
mation, and it is just a notation for the antiderivative. 
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To resolve this problem we need a more usable version of the fundamental 
theorem of calculus, which is a basic result used regularly in differential equa- 
tions. It provides an expression for the antiderivative of a function in terms of a 
definite integral with a variable upper limit. You should consult your calculus 
text. 


Theorem 1.12 


(Fundamental Theorem of Calculus) If g(¢) is a continuous function, the 
derivative of an integral with variable upper limit is 
d t 


i g(s)ds = g(t), 


where the lower limit a is any number. 


A simple illustration of Theorem (1.12) is 
d t 
al sin (V1 +s?) ds =sin(V1 +). 
2 


The theorem states that the function G(t) = f g(s)ds is an antiderivative 
of g, i.e., a function whose derivative is g. Therefore, 


G(t) -| g(s)ds +C 


is also an antiderivative for any value of C. This last expression is the most 
general form of the antiderivative of g(t). 

Functions defined by integrals are common in the applied sciences and are 
equally important as functions defined by simple algebraic formulas. To the 
point, in most calculus texts the natural logarithm Int is defined as the inverse 
of the exponential function, ce’. However, in other texts the natural logarithm 
is defined by the integral 


a 
nt = [ —ds, t>0. 
1 § 


An important perspective is that differential equations often define special func- 
tions. For example, the initial value problem 


can be used to define the natural logarithm function Int. Many special functions 
encountered in mathematical physics and engineering are defined by integrals. 
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Example 1.13 


We return to the initial value problem in Example 1.11: 


From the fundamental theorem of calculus we write the antiderivative as 
t 2 
x(t) =| e °ds+C. 
0 


The common strategy is to take the lower limit of integration to be the initial 
value of t, here zero. Then x(0) =0+C = 2, or C = 2. We obtain the solution 
to the initial value problem in the form of a definite integral with a variable 
upper limit of integration, 


t 
x(t) =|} e-* ds +2. 
0 


Calculators and computer algebra systems plot such functions easily. 


Some functions defined by integrals are often given a name, particularly if 
they occur frequently. For example, we can define the special function “erf” 
(called the error function) by 


2 t 
erf(t) = = | eds. (error function) 
) 


The factor 2/,/z in front of the integral normalizes the function so that 
erf(+oo) = 1. The erf function erf(t) gives the area under the bell-shaped 
curve (2/,/7) exp(—s”) from 0 to t. The erf function, which is plotted in Fig- 
ure 1.6, is an important function in probability and statistics, and in diffusion 
processes. Its values are tabulated in computer algebra systems and mathemat- 
ical handbooks. 


EXERCISES 


1. Find the general solution to the differential equation 
a’ = tcos(t?). 


Find the particular solution satisfying the initial condition x(0) = 1, and 
plot the solution on the interval —5 <t <5. 
2. Solve the initial value problem 2’ = (t + 1)/V#, x(1) = 4. 


3. Find a function x(t) that satisfies the initial value problem 2” = —3V‘, 
x(1) =1, (1) =2. 
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-5 0 5 
t 


Figure 1.6 Plot of the erf function on the interval [-5,5] using the MATLAB 
commands: t=-5:0.01:5; u=erf(t); plot(t,u). 


4. Find all functions that solve the differential equations: 
(ay a =te.. (bh) 2’ =1/Glng). (c) ser = cos. 


5. (Mechanics) A car of mass m is moving at speed V when it has to brake. 
The brakes apply a constant force F' until the car comes to rest. How long 
does it take the car to stop? How far does the car go before stopping? Now, 
with specific data, compare the time and distance it takes to stop if you are 
going 30 mph versus 35 mph. Take m = 1000 kg and F = 6500 N. Write a 
short paragraph on recommended speed limits in residential areas. 


6. Find the solution to the initial value problem x’ = e~'/Vt, a(1) = 0, in 
terms of an integral with a variable upper limit. Plot the solution on the 
interval [1,4] using a computer algebra system. 


7. Solve the initial value problem for 7 = x(t): 


d {dz j 
é (=) =1, a(l)=1, 2) =2. 


8. (Physics) A ball of mass m is tossed upward from a building at height 
h with initial velocity v. The only force acting on the ball is the force of 
gravity, F = —mg, where g is the acceleration due to gravity. Let « = x(t) 
denote the height above ground level at time ¢t. By Newton’s second law 
the initial value problem is 


maz” =—mg, 2«(0)=h, x'(0) =v. 


1.2 


10. 


11. 


12. 


13. 


14. 
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Solve the IVP and show that the height is given by the familiar formula 


1 
x(t) = aot +ut+h. 


. The differential equation x’ = 3x+e~* can be converted into an antideriva- 


tive problem for a new dependent variable y = y(t) using the substitution 
x(t) = y(t)e®". Find the differential equation for y, solve it, and then deter- 
mine the general solution x = x(t) of the original equation. 


Use the chain rule and the fundamental theorem of calculus to compute 
the derivative of the following functions: 


(a) f(t) =erf(sint). (b) f(t) =tf, e~¥*ds. 


A function is defined by the expression 


Find a differential equation for y = y(t). 


An enemy cannon at horizontal distance L from a fort can fire a cannon ball 
from the top of a hill at height H above the ground level with a muzzle 
velocity v. How high should the wall of the fort be to guarantee that a 
cannon ball does not go over the wall? Observe that the enemy can adjust 
the angle @ of its shot. Hint: Ignoring air resistance, the governing equations 
follow from resolving Newton’s second law for the horizontal and vertical 
components of the force: ma” = 0 and my” = —mg. 


An integral equation is an equation where the unknown x = x(t) appears 
under an integral sign. Such equations arise in many applications. An exam- 
ple is the equation 


Transform this equation into an initial value problem for x(t). Hint: Dif 
ferentiate. 


Transform the integral equation 
t 
x(t) +f es) (s)ds =b; a, b constants, 
0 


into an initial value problem and find the solution x = x(t). 
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15. Show how the initial value problem 2’ = f(t,x), «(0) = ao, can be trans- 
formed into the integral equation 


x(t) =29+ [ f(s, a(s))ds. 
Transform the initial value problem 
a’ =5tz?+1, 2x(1)=0 
into an integral equation. 


16. Using your calculator, plot the function 


t 2 
o(t) = fe ds+2, 0<t<4. 
) 


17. (Leibniz rule) Define the function I(t,b) = Nie f(t,s)ds of two variables. 
Then ; 
Or Or 
af fltss)as, = F(t). 
Use the chain rule to show Leibniz rule: 
d b(t) 


ait b(t)) = fi(t, s)ds + f(t, b(t))v'(t). 


1.3 Separable Equations 
1.3.1 Separation of Variables 


A differential equation having the form 


a = f(x)g(t), (1.11) 


where the right side is a product of a function of x and a function of t, is called 
a separable equation. 

The procedure to solve (1.11) is simple. To do so we usually write (1.11) in 
the notation 


dx 
=—= t). 
= s(a)g(t) 
We divide by f(x) to obtain 
1 dz 
7S = git), 
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Integrating with respect to t (remember, «x is a function of t) we get 


lz Ne at= f g(t) at 


But x = x(t), so dx = 4 dt. Then 


1 
| apte= [sore (1.12) 


where C is an arbitrary constant. After calculating the two integrals, if possible, 
we obtain a one-parameter family of curves (t,x) = C in x and t, called the 
integral curves of (1.11); we get one curve for each value of C. The integral 
curves define implicit solutions of the equation. To find explicit solutions 
we must solve for « = x(t) in terms of ¢ and C. If there is an initial condition, 
it determines the value of C. 


Example 1.14 
Solve the equation 
dz t 
dt «2 
Separating the variables we get 
ge = 
dt 


Integrating, 


or, since dx = a dt, 


feac= frat, 


1 1 

= =? +C. 

a” = 5 

This one-parameter family of integral curves, which are hyperbolas in the ta 
plane, define the solutions z = x(t) implicitly. To find explicit solutions we 


must solve for 7. Multiplying by 2 and taking the square root of both sides 


gives 

a(t) =+Vt7+C, 
where we have replaced 2C’ by C. (2 times an arbitrary constant C’ is just 
another arbitrary constant, which we again call C.) 


or 


If we are given an initial condition, say 


x(2) =1, 
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then 2(2) = +V2? + C = 1, then we are forced to take the positive square root 
and obtain C = —3. Therefore, the solution to the IVP 


dx t 
ae a(2) 
is 
x(t) = Vt? — 3. 


The solution to the IVP is defined only when t > V3, the interval of 
existence. 


Remark 1.15 


(Recipe) The method of separation of variables for the equation 


& = F(a)alt) 


just results in writing down 


where the x terms are placed on the left and the t terms on the right, including 
the two differentials dz and dt. Then we integrate to get 


| aoe- [swerve 


This is the recipe used to solve problems. We usually dispense with integrating 
both sides with respect to t and then changing variables. We go directly to the 


last equation. 


Example 1.16 

(Growth and Decay) Consider the differential equation 
dx 
—= 1.1 
Frank (1.13) 


where r is a given constant. If r < 0 this is the decay equation; if r > 0 then it 
models exponential growth. This equation is separable. We write 


1 
—dx = rdt. 
x 


Integrating gives 
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or 
Injaj=rt+C or |2| =e"? = e%e™, 


This means x = te@e"™. Therefore, the general solution of the growth—decay 


equation can be written compactly as 


a= Cer 


where te° has been replaced by C. This is the same solution we obtained 
earlier in a different way. 


Remark 1.17 


Sometimes it is convenient in an initial value problem to integrate both sides 
of the equation using definite integrals with variable upper limits. For example, 
consider the IVP F 

AIF), (to) = 0. 
Then we write 


1 


and then integrate both sides as follows: 


x 1 t 
oa Fw = a g(s)ds, 


where we have introduced two dummy variables, one in each integrand. Then 
we calculate the integrals as usual and obtain, after simplification, the solution 
x = x(t) to the IVP. No constants of integration are introduced. 


Example 1.18 


Solve the initial value problem for t > 1: 


dt ¢t °? 


The equation is separable so we separate variables and integrate: 


9 —t 
oy LE Ee 


1 t 1 t o-s 

= | — dy= fds. 

2J4 JY i) 8 
We can integrate the left side exactly, but the integral on the right cannot be 
resolved in closed form. Integrating the left side then gives 


ve-va= ff — de. 


Ss 
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Solving for x gives 


w= (fasts). 


This solution is valid on 1 < t < co. In spite of the apparent complicated form 
of the solution, which contains an integral, it is not difficult to plot using a 
calculator. 


EXERCISES 


1. Use the method of separation of variables to find the general solution to 
the following differential equations. 


(al a Safa (e) a2’ =aut+b, a,b>0. 
, 2a r Q 
(b) wv =e a (f) aa ewe 
(c) yf =1+y?. (g) a =e. 
1 
(@ v=. (h) vf =ra-y). 


2. Solve y’ = r(a— y), where r and a are constants. 
3. In Exercises 1(a)—(b) find the solution to the resulting IVP when (0) = 1. 


4. Find the general solution: 


Bi. 2x fo 2 
(a) v= ra (dq) R= G+) +1). 
(b) 6 =tVt? +1 secé. (e) +y+o=0. 
(c) (2ut+1)u’ —(t+1) =0, (f) (¢+1)2' +27 =0, 


5. Solve the initial value problem and find the interval of existence. 
dy ss 1 


= = —_ 0)=1. 
dt = 2y+1’ y(0) 


6. Find the interval of existence for the initial value problem 


c = (4t-—2)*, 2«(0)=1. 


Hint: Change the dependent variable to y = y(t) where y = 4t — a. 
7. Determine the maximum interval of existence of the solution x = x(t) to 


z' = 2ta*, 2«(0)=1. 
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10. 


11. 


12. 


13. 


. Find the solution to the initial value problem 


g =e *, .2(0) =1n2, 


and determine the interval of existence. 


. Solve x’ = «(44+ 2) subject to the initial condition x(0) = 1. Hint: It is 


helpful to use a partial fractions expansion 


1 a b 


r(4+z) ae 4+’ 
where a and 6 are to be determined. 
Solve the following initial value problems.: 


ay Gee. sg( 0) = 0: 


b) 4 = 2at(T? -a?), T(0)=0. 


c) #=#tany, y(0) =0. 
Find the general solution in implicit form to the equation 


x! (4+ 2t)a 


Ing 


Find the solution when x(0) = e and plot the result. What is the interval 
of existence? 


Solve the initial value problem 


Qty? 


= T+’ y(0) = yo 


y 


and find the interval of existence when yo < 0, when yo > 0, and when 
yo = 0. 
The integral curves of the differential equation 


dx t? 
dt 1—22 


are —t? + 3a — 2° = C. (a) Using implicit differentiation, verify that the 
integral curves represent solutions. (b) Find the curve passing through 
x = 1 at t = 1, and plot it in the tz plane. Hint: Plot t versus z. (c) 
Does the initial value problem with initial condition x(1) = 1 have only 
one solution? 
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14. 


15. 


16. 


17. 


18. 


1. First-Order Differential Equations 


A differential equation has integral curves 
go +27 = C. 


(a) Sketch several of these curves in the tx plane. (b) Find the differential 
equation. (c) Find the explicit solution satisfying the condition t = 1, = 4 
and determine its interval of existence. 


Find the general solution of the DE 
a’ = 6t(2 —1)?/°. 


Clearly, x(t) = 1 is a constant solution. Solve the DE and show that there 
is no value of the arbitrary constant that gives the solution a(t) = 1. (A 
solution to a DE that cannot be obtained from the general solution by 
fixing a value of the arbitrary constant is called a singular solution.) 


(Mechanics) We modeled the velocity of an object falling in a fluid by the 
equation mv’ = mg — av’. Use separation of variables and partial fractions 
to show that the general solution is 


(y= (So), 2a 


a \et’'+Ce-" m 


If v(0) = V, determine the constant C' and then find the limiting, or ter- 
minal, velocity. 


Find the general solution to the logistic equation x’ = ra(1 — 2/K) using 
separation of variables. Hint: use the partial fractions decomposition 


1 _WK | WK 
a(K—2) ¢ K-«x 


(Population Growth) In this exercise derive the logistic model in an alter- 
nate way. Suppose the per capita growth rate of a population x = a(t) is 
the birth rate minus the death rate, or r — c;x, where r is the birth rate 
and c; is the coefficient of intra-specific (internal, within the population) 
competition. As the population increases there is greater competition for 
the existing resources, which decreases the growth rate and limits growth. 


Define c; by 
—_ demand for resources D 


“i “total resources. 
The dimensions of D are resources/time per animal, and H is given in 
resources. Derive the logistic law, and show that the carrying capacity is 
K =rH/D, given in animals. 
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19. 


20. 


2d. 


22. 


23. 


(Tumor growth) One model of tumor growth is the Gompertz equation 
a“ 52 CR), 


where R = R(t) is the tumor radius, and a and k are positive constants. 
Solve the Gompertz equation for R(t)? 


(Allometry) Allometric growth describes temporal relationships between 
sizes of different parts of organisms as they grow (e.g., the leaf area and 
the stem diameter of a plant). We say two sizes x and y are allometrically 
related if their relative growth rates are proportional, or 


Show that if x and y are allometrically related, then « = Ky", for some 
constant IK. 


(Homogeneous Equations) A differential equation of the form 


#-r(8). 


where the right side depends only on the ratio of x and t, is called homo- 
geneous. Show that a homogeneous equation can be transformed into a 
separable equation by changing the dependent variable from x to y via 
x(t) = ty(t). Use this method of substitution to solve the equation 


dx At? + 3x? 
dt tg 
Show that the differential equation 
d. 
= = F(at+ bx +c) 


can be transformed into a separable equation by making a transformation 
y = at + ba +c to a new dependent variable y = y(t). Solve the following 
equations: 


(a) ata () 


dx 


ae ee 


Solve the initial value problem for x = x(t): 
di) oat -t 
a (we \Se-%. a0) =2, 
Hint: Integrate both sides. 
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24. 


25. 


26. 


27. 


28. 


29. 


1. First-Order Differential Equations 


Find the general solution x = x(t) of the DE 


(Epidemiology) A population of uo individuals all have HIV, but none 
has the symptoms of AIDS. Let u(t) denote the number that does not 
have AIDS at time ¢ > 0. If r(t) is the per capita rate of individuals 
showing AIDS symptoms (the conversion rate from HIV to AIDS), then 
u'/u = —r(t). In the simplest case we can take r to be a linear function 
of time, or r(t) = at. Find u(t) and sketch the solution when a = 0.2 and 
uo = 100. At what time is the rate of conversion maximum? 


Find the general solution of 


dy _ y? + 2ty 


dt t? 


In very cold weather the thickness of ice on a pond increases at a rate 
inversely proportional to its thickness. If the ice initially is 0.05 inches 
thick and 4 hours later it is 0.075 inches thick, how thick will it be in 
10 hours? 


Write the solution to the initial value problem 


dy Dt? 
—_—_ — 0 — 
7 ye <2 (0) 


in terms of the erf function. 


(Demography) Let No be the number of individuals in a cohort at time 
t =0 and N = N(t) be the number of those individuals that are still alive 
at time t. If m is the constant per capita mortality rate, then N’/N = —m, 
which gives N(t) = Noe~™. The survivorship function is defined by S(t) = 
N(t)/No, and S(t) therefore gives the probability of an individual living to 
age t. In the case of a constant per capita mortality the survivorship curve 
is a decaying exponential function S(t) = e~™. 

a) What fraction of the cohort die before age t? Calculate the fraction 

that die between age a and age b. 


b) If the per capita death rate depends on time (or age), or m = m(t), 
find a formula for the survivorship function (your answer will contain 
an integral). 


c) What do you think the human survivorship curve S(t) might look like? 
What about an insect’s survivorship curve? 
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1.3.2 Heat Transfer 


A small object of uniform temperature To is placed in an environment oven of 
constant temperature T.. (E.g., a chemical sample, or even a potato, is placed 
in an oven.) Over time the object heats up and eventually its temperature is 
that of the environment, T.. We want a model that governs the temperature 
T(t) of the object at any time t. Newton’s law of cooling (or, heating), 
states that the rate of change of the temperature of the object is proportional 
to the difference between the temperature of the object and the environmental 
temperature. That is, 

T’ =—h(T —T.). (1.14) 
The positive proportionality constant h is the heat loss coefficient and it mea- 
sures how fast an object releases or absorbs heat. There is a fundamental 
assumption that the heat is instantly and uniformly distributed throughout 
the object and there are no temperature gradients, or spatial variations, in the 
body itself. From the DE we observe that T = T(t) = T. is a constant solu- 
tion. Because it is not changing, it is called an equilibrium solution. If T > Te 
then T’ < 0, and the temperature decreases; if T < T. then T’ > 0, and the 
temperature increases. We can easily find a formula for the temperature T(t) 


Th 


T, 


T= T(t) 


oo 


> 


t 


Figure 1.7 Temperature history in Newton’s law of cooling showing how the 
temperature T(t) approaches the equilibrium temperature when Tp < Ty. 


satisfying (1.14) using separation of variables. Write the equation as 


dT 
T=Te 


= —hdt. 


Integrating gives 
In| T-—T,. |= —ht +C. 


Exponentiating both sides gives 


[eatiae" es, 
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or, renaming the arbitrary constant, 


T-TeaGe™, 


Hence, 


T(t) =T.+Ce™, 


which is the general solution of (1.14) containing an arbitrary constant C’.. When 
we impose an initial condition T(0) = To, then we find C = Tp — Tz, giving the 
particular solution to the initial value problem: 


Ti) =T. +(T—Teje™. 


Immediately we observe that T(t) ~ T. as t > oo. A plot of the solution 
showing how an object heats up is illustrated in Figure 1.7. 


EXERCISES 


1. A small turkey at room temperature 70°F is placed into an oven at 350°F. 


If h = 0.42 per hour is the heat loss coefficient for turkey meat, how long 
should you cook the turkey so that it is uniformly 200°F? Comment on 
the validity of the assumptions being made in this model? 


. A pan of water at 46°C was put into a refrigerator. Ten minutes later the 


water was 39°C, and ten minutes after that it was 33°C. Estimate the 
temperature inside the refrigerator. 


(Forensics) The body of a murder victim was discovered at 11:00 A.M. The 
medical examiner arrived at 11:30 A.M. and found the temperature of the 
body was 94.6°F. The temperature of the room was 70°F. One hour later, 
in the same room, he took the body temperature again and found that 
it was 93.4°F. Estimate the time of death. What assumptions are being 
made? 


(Home heating) Suppose the temperature inside your winter home is 68°F 
at 1:00 P.M. and your furnace then fails. If the outside temperature is 10°F 
and you notice that by 10:00 P.M. the inside temperature is 57°F, what is 
the temperature in your home the next morning at 6:00 A.M.? 


1.3.3 Chemical Reactors 


A continuously stirred tank reactor (also called a chemostat, or compartment) 
is a basic unit of many physical, chemical, and biological processes. It is a well- 
defined geometric volume where substances enter, react, and then discharged. 
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———_—____| 


V 
q Cin ——> CY) —* 4 CO) 


Figure 1.8 A chemostat, or continuously stirred tank reactor. 


A chemostat could be an organ in our body, a polluted lake, an industrial 
chemical reactor, or even an ecosystem. See Figure 1.8. 

We illustrate a reactor model with a specific example. Consider an industrial 
pond with constant volume V cubic meters. Suppose that polluted water con- 
taining a toxic chemical of concentration Ci, grams per cubic meter is dumped 
into the pond at a constant volumetric flow rate of g cubic meters per day. At 
the same time the continuously mixed solution in the pond is drained off at 
the same flow rate q. If the pond is initially at concentration Co, what is the 
concentration C(t) of the chemical in the pond at any time t? 

The key idea in all chemical mixture problems is to obtain a model by 
conserving mass: the rate of change of mass in the pond must equal the rate 
mass flows in minus the rate mass flows out. The total mass in the pond at any 
time is VC, and the mass flow rate is the volumetric flow rate times the mass 
concentration; thus mass balance dictates 


(VC)’ = qCin — GC. 
Hence, the initial value problem for the chemical concentration is 
vc = qCin = qc, C(0) = Co, (1.15) 


where Co is the initial concentration in the tank. This initial value problem can 
be solved by the separation of variables method. 

A similar reactor model holds when the volumetric flow rates in and out 
are different, which gives a changing volume V(t). Letting gin and qout denote 
those flow rates, respectively, we have 


(V(E)C)’ = GinCin _ doutC, 


where V(t) = Vo + (Gin — Gout )t, and where Vo is the initial volume. Methods 
developed in Section 2.1 show how to handle this equation. 

Now suppose we add degradation of the chemical while it is in the pond, 
assuming that it degrades to inert products at a rate proportional to the amount 
present. We represent this decay rate as kC’ gm per cubic meter per day, where 
k is the rate constant in units of time. Then the model equation becomes 


VC' = qCin — dC — kVC. 
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Notice that we include a factor V in the last term to make the model dimen- 
sionally correct. 


Also, the chemical can be consumed or created in the reactor by a chem- 


ical reaction. The law of mass action from chemistry dictates the rate of the 


reaction. The exercises present some examples. 


EXERCISES 


i, 


Solve the initial value problem (1.15) and obtain a formula for the concen- 
tration in the reactor at time tf. 


. (Pollution) An industrial pond having volume 100 m? is full of pure water. 


Contaminated water containing a toxic chemical of concentration 0.0002 kg 
per m® is then is pumped into the pond with a volumetric flow rate of 0.5 m3 
per minute. The contents are well-mixed and pumped out at the same flow 
rate. Write an initial value problem for the contaminant concentration C(E) 
in the pond at any time t. Determine the equilibrium concentration and its 
stability. Find a formula for the concentration C(t). 


In the preceding problem, change the flow rate out of the pond to 0.6 m° 
per minute. How long will it take the pond to empty? Write, but do not 
solve, the revised initial value problem. 


A vat of volume 1000 gallons initially contains 5 lbs of salt. For t > 0 
pure water is pumped into the vat at the rate of 2 gallons per minute; the 
perfectly stirred mixture is pumped out at the same flow rate. Derive a 
formula for the concentration of salt in the tank at any time t. Sketch a 
graph of the concentration versus time. 


A vat of volume 1000 gallons initially contains 5 lbs of salt. For t > 0a 
salt brine of concentration 0.1 lbs per gallon is pumped into the tank at 
the rate of 2 gallons per minute; the perfectly stirred mixture is pumped 
out at the same flow rate. Derive a formula for the concentration of salt in 
the tank at any time t. Sketch a graph of the concentration versus time. 


Consider a chemostat of constant volume where a chemical C is pumped 
into the reactor at constant concentration and constant flow rate. While in 
the reactor it reacts according to C' + C — products. From the law of mass 
action the rate of the reaction is r = kC?, where k is the rate constant. If 
the concentration of C' in the reactor is given by C(t), then mass balance 
leads the governing equation (VC)! = qCin —gqC —kVC?. Find the constant 
solutions, or equilibrium states, of this equation. What are the units of k? 


7. 


10. 
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(Enzyme kinetics) Work Exercise 6 if the rate of an enzyme reaction is 
given by Michaelis-Menten kinetics 


aC 
, = -clocc 
b+C’ 


where a and 0 are positive constants. 


(Batch reactor) A batch reactor is a reactor of volume V where there are 
no in and out flow rates. Reactants are loaded instantaneously and then 
allowed to react over a time T, called the residence time. Then the con- 
tents are expelled instantaneously. Fermentation reactors and even sacular 
stomachs of some animals can be modeled as batch reactors. If a chemical 
is loaded in a batch reactor and it degrades with rate r(C) = kC, given in 
mass per unit time, per unit volume, what is the residence time required 
for 90 percent of the chemical to degrade? 


(Reaction kinetics) Consider the chemical reaction A+B +, ©, where one 
molecule of A reacts with one molecule of B to produce one molecule of 
C, and the rate of the reaction is k, the rate constant. By the law of mass 
action in chemistry, the reaction rate is r = kab, where a and b represent 
the time-dependent concentrations of the reactants A and B. Thus, the 
rates of change of the reactants and product are governed by the three 
equations 
a’ =—kab, b' =—kab, c =kab. 


Initially, a(0) = ao, b(0) = bo, and c(0) = 0, with ap > bo. Show that a—b = 
constant = ap — bo, and find a single, first-order differential equation that 
involves only the concentration a = a(t). What is the limiting concentration 
limy-,o0 a(t)? What are limiting concentrations of B and C? 


(Digestion) Digestion in the stomach (gut) in some simple organisms can 
be modeled as a chemical reactor of volume V, where food enters and is 
broken down into nutrient products, which are then absorbed across the 
gut lining; the food—product mixture in the stomach is perfectly stirred 
and exits at the same rate as it entered. Let Sp be the concentration of a 
substrate (food) consumed at rate g (volume per time). In the gut the rate 
of substrate breakdown into the nutrient product, S — P, is given by kV'S, 
where k is the rate constant and S = S(t) is the substrate concentration. 
The nutrient product, of concentration P = P(t), is then absorbed across 
the gut boundary at a rate aVP, where a is the absorption constant. At 
all times the contents are thoroughly stirred and leave the gut at the flow 
rate q. 
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a) Argue that the model equations are 


VS’ =qSo-—qS —kVS, VP!’ =kVS—aVP —@P. 


b) Suppose the organism eats continuously, in a steady-state mode, where 
the concentrations become constant. Find the constant solutions, or 
equilibrium concentrations S, and P.. 


c) Some ecologists believe that animals regulate their consumption rate 
in order to maximize the absorption rate of nutrients. Show that the 
maximum nutrient concentration P. occurs when the consumption rate 


is gq = Vakv. 


d) Show that the maximum absorption rate is therefore 
akSoV 


(Va+ VRP 


1.4 Linear Equations 
1.4.1 Integrating Factors 


A differential equation of the form 
x’ + p(t)x = q(t). (1.16) 


is called a first-order linear equation. If a first-order equation cannot be 
put into the form (1.16), the equation is called nonlinear. Equation (1.16) 
is called the normal form of a first-order linear equation. The procedure we 
present to solve a linear equation requires that it be in normal form, with the 
coefficient of x’ equal to 1. 


Example 1.19 
The equation 
(sint)a’ = 3tr + Vt 
is linear, but not in normal form. But we can divide by sint and write it as 


ot vt 


sint sint’ 
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with p(t) = —3t/sint and q(t) = Vt/sint. It is now in normal form. The 
equation 
x’ + (cost)xx’ = 2 


is nonlinear. Clearly the equation t?z’ — 4(t + 1) = 0 is linear and the normal 
form is 
,_ 4(t+1) 
t2 


Here, p(t) is zero. 


For this discussion we assume the prescribed functions p and q in (1.16) are 
continuous. These equations occur frequently in applications. If q(t) = 0, then 
the equation (1.16) is called homogeneous; the homogeneous equation is 


x + p(t)x = 0. 


Observe that the homogeneous equation is separable, and its solution is easily 
found to be 


a(t) = Ce fram, C’ an arbitrary constant. 


In this context equation (1.16) is called nonhomogeneous. 

Because of its role in applications, the function q(t) in (1.16) is called the 
source term or forcing term. 

The left side of a linear equation in normal form, (1.16), has a very nice 
property: the left side of the equation can be multiplied by a function p = p(t) 
that transforms it into a total derivative. In other words, there is a function 
pe = p(t) such that 


/ 


u(t) (a! + p(t)x) = (u(t)x) . 


The function p(t) is called an integrating factor and it is given by 
p(t) = eS PO 4# — eP, where P(t) = [ow dt; 


P(t) is the antiderivative of p(t). By the product rule and the chain rule it is 
easy to check that it works: 


(u(t)ar)' = (e? x) 
=eP Og! + ePOn(t)ax (because P’(t) = p(t)) 
= p(t)x' + p(t)p(t)x = p(t)(a' + p(t)z), 


which is our claim. 
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Procedure for solving a linear equation 
Step 1. Multiply both sides of the normal form of the equation 
a + p(t)x = q(t) 
by the integrating factor 
u(t) = ed Pte) dt _ oP). 


Step 2. Obtain 
/ 
(cPOx) = eP a(t). 


Step 3. Integrate (take the antiderivative) both sides to obtain 


ePOx(t) = ferent jdt +C. 


Step 4. Multiply by e~?™ to obtain the general solution 


a(t) = e-P®) / eP Ont) dt +Ce~P™, (1.17) 


Remark 1.20 


If any of the integrals required in the procedure cannot be computed in closed 
form, then they should be written as a definite integral with variable upper 
limit. For example, the integrating factor 


ED SelrO®, 


can always be written 
p(t) = ela Pt) ae, 


where we usually take the lower limit a to be the time corresponding to an 
initial condition. 


Example 1.21 


Solve the equation 
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Here p(t) = 1/t and q(t) = 1. The integrating factor is 
p(t) = ef (/t) dt _ (Int + 
Multiplying both sides of the DE by t gives 
te’ +ae=t; or (tx) =t. 
Integrate both sides: 


1 


ta = —t? 
L 5 +C 
Therefore 1 C 
th=-t+— 

wy) Sots = 


which is the general solution. The arbitrary constant C' is determined from an 
initial condition. For example, if the initial condition 


x(1) = 3, 
is imposed, then 
1 C 5 
1)==(1)+—=3 — 
a= +a =38 oF ; 
Therefore the solution to the initial value problem is 
1 5 
t)=-t+r—. 
OO oe 


Here is an example involving a more difficult integration. 


Example 1.22 
Consider the differential equation 
x +22 =sint. 
We multiply the DE by the integrating factor 
u(t) = es 2dt — ,t 


to get 
(xe?*)’ = e** sint. 


Integrating both sides gives, 
*! sint dt + C, 


we = Je 
z(t) =e" ** / e* sintdt + Ce~*". 


or 
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The integral on the right side can be calculated using integration by parts (or 
consulting an integral table). In any case we obtain the general solution 


2 1 
x(t) =e * [e (2 sint — 5 008 ‘)| +Ce* 


—2t 


1 
— 5 Sint — ; cost + Ce 


The solution (1.17) to the first order linear equation has a general structure 
that it shares with other linear nonhomogeneous equations of higher order. The 
result is easily obtained by comparing it to (1.17). 


Theorem 1.23 
(Structure Theorem) Consider the first-order linear equation 
a’ + p(t)a = g(t). 


The general solution x(t) is the sum of the general solution to the homogeneous 
equation plus any solution to the nonhomogeneous equation. That is, it is the 
sum of the homogeneous solution and a particular solution: 


a(t) = tn(t) + rp(t), 


where 


a,(t)=Ce-P®, 2, (t)= PO f g(the” Mat 


Therefore, the solution consists of two parts: a so-called transient solution 
an(t) = Ce~P 


involving the initial condition, which determines C, and a so-called steady-state 
solution 


ade °° . q(t)eP dt 


involving the nonhomogeneous term q(t). In mathematical jargon, xp(t) is 
called the homogeneous solution (or the complementary solution in some texts) 
because it satisfies the homogeneous equation; x,(t) is called a particular solu- 
tion because it is a specific solution to the nonhomogeneous equation. 


Example 1.24 


Consider the DE 


vw’ —382=e%. 
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The integrating factor is p(t) = exp({ —3dt) = e~**. Multiplying through by 
the integrating factor, the DE becomes or 


Integrating both sides gives 


1 
re 3* —-CO-~ cael 
or ‘ 
x(t) = Ce** rae 


which is the general solution. It is the sum of the homogeneous solution and a 
particular solution. The solution to the homogeneous equation x’ — 3a = 0 is 
rh (t) = Oe, 
which is a growing exponential solution. The particular solution is 

iL 
L(t) = —=e, 
»()=-3 


which involves the nonhomogeneous term; it decays away as t — +00. (The 
reader should check that this is a solution to the nonhomogeneous equation 
x’ — 32 =e.) 


Example 1.25 


Observe that the differential equation 7’ = ax + 6 can be solved by three 
different methods: separation of variables, integrating factors, or making the 
substitution y = ax + b. See Exercise 9. 


EXERCISES 


1. Classify the first-order equations as linear or nonlinear. 


a) a’ = 2032-6. d) Tt?a' = 3a — 2¢. 
b) (cost)a’ — 2a sinx = 0. e) va’ =1—ta. 


=t—<27. f) (2)? +ta = Jt+ 1. 
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10. 


11. 


12. 


1. First-Order Differential Equations 


. Find the general solution. 


a) a! = —(2/t)x +t. d) tae’ =—-x+t?. 
b) y’ +y=et. e) 6 = —aé + exp(0t). 
c) a +2tx=e"". f) (#2 +1)x’ = —3ta + 6t. 


. Solve the initial value problems. 


a) a + (5/t)e =1+¢t, 2(1) =1. d) N’=N-—9e~*, N(0) = No. 
ba (e+?) ae 1, e) cosOu’ + v =3, v(m/2) = 1. 
) R4+8= 25, Rls.) R= B+ te, RQ) =1. 


. Show that the general solution to y’ + ay = /1+t is given by 


t 
y(t) = Ce +f e U8) /T + sds. 


0 


. Express the general solution of the equation x’ = 2tx +1 in terms of the 


erf function. 


. Find a formula for the solution of 


et 
a+ Stat, (1) =O; 


. Solve x” + x’ = 3t by substituting y = 2’. 
. Solve x’ = (t+ 2x)? by substituting y = t+ 2. 


. Find the general solution to the differential equation x’ = ax + b, where 


a and 6 are constants, first by separation of variables, and second by inte- 
grating factors. 


Find the general solution to the DE x’ = pa + q(t), where p is constant. 
Then find the solution satisfying x(to) = Zo. 


Consider the linear differential equation x’+p(t)x = q(t), and let 7, = x1 (t) 
and £2 = X2(t) be solutions. (a) Show that the sum a(t) = 1 (t) + r2(t) 
is a solution if, and only if, g(t) = 0. (b) If a1 = x(t) is a solution to 
x’ + p(t)x = 0 and x2 = £2(t) is a solution to a’ + p(t)a = q(t), show that 
x(t) = #1 (t) + x(t) is a solution to a’ + p(t)a = q(t). 


Show that if 2} = a(t) and z2 = 22(t) are both solutions to the DE 
x’ + p(t)x = 0, then x)/x2 is constant. Hint: Use the quotient rule for 
derivatives. 


1.4 


13. 


14. 


15. 


16. 
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A population law is given by N’ = r(t)N —h, where r(t) is a prescribed 
time-dependent growth rate and h is a constant predation rate. (a) If the 
initial population is N(0) = no, find the solution to the population problem. 
(b) Plot the solution if r(t) = $(1+sint) and no = 8, h = 0.4. Assume N 
is given in hundreds of animals. 


(Bernoulli equations) A differential equation of the form 
x’ =a(t)x + g(t)x” 


is called a Bernoulli equation, and it arises in many important appli- 
cations. Show that the Bernoulli equation can be reduced to the linear 
equation 

y' = (1—n)a(t)y + (1—n)g(t) 
by changing the dependent variable from x = x(t) to y = y(t) viay = x 
Observe that the solution is therefore x = y!/(-™, 


1-n 


Solve the Bernoulli equations: 

a) a = Sa4H, d) t?y' + 2ty—y® =0. 

b) a’ = 2(1+2e’). e) z’ =az+ bx?, a, b>0. 
c) 0 =-40+ qh. f) vw’ =tw+ tw’. 


(Exact equations). In this exercise we consider a special class of first-order 
differential equations called exact equations, which occur in many appli- 
cations. They have the form 


f(t,z) + g(t, 2)x' =0, (1.18) 


where the left side has the form of a total derivative. That is, there is a 
function H = H(t,x) for which 


Ht, ec ew rire 


From the chain rule the total derivative of H(t, 2) is also 


d 

dt 
Therefore, if H, = f and H, = g, then the differential equation is exact. 
Then the differential equation can be written fH (t,2) = 0, which implies 
H(t, x) = C, for some arbitrary constant C. Therefore the integral curves, 
or solution of (1.18) is given implicitly by H(t, x) = C. 


A(t, 2) = Ay(t, 2) + Ae (t,2)2'. 
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a) Show that f(t,x) + g(t, x)2’ = 0 is an exact equation if fr, = g. (This 
condition is also implied by exactness.) 


b) Use part (a) to check if the following equations are exact. If the equa- 
tion is exact, find the general solution by solving H; = f and Hz = g 
for H. (You may want to review the method of finding potential func- 
tions associated with a conservative force field from your multivariable 
calculus course.) Write the solution, or integral curves. 


i) 2° + 3ta2’ =0. iv) w3dt + 3ta*dx = 0. 
ii) +24 (2? +Int)r’ =0. v) a7dt — t?dx = 0. 
iii) v’ = FRE. v) t(cotx)a’ = —2. 


(Orthogonal trajectories) Solutions to a first-order equation form a set of 
integral curves of the form ¢(z,y) = C, where C is a constant. (Here we 
are using x and y as variables because the topic is geometry in the plane.) 
The integral curves, for example, may be the equipotential curves of a con- 
servative force field, such as an electric field. Every set of integral curves is 
defined by a differential equation ¢,dx + dydy = 0, or dy/dz = —¢z/dy. 
We often want to find the integral curves that are perpendicular, or orthog- 
onal, to the given curves; these are called the orthogonal trajectories. 
For example, we may want to find the flux lines of the electric field. Because 
orthogonal families of curves are perpendicular, their slopes are negative 
reciprocals. Therefore, the integral curves orthogonal to ¢(, y) = C satisfy 
the differential equation 


dy _ by 

dz by 
Plot the following integral curves and then find and plot the orthogonal 
trajectories. 
a) 2? +y=C. b) ay =C. ce) y= C2’. 


1.4.2 Applications 


Now we consider some practical examples of linear models, which are myriad. 
Additional ones are given in the exercises. 
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Example 1.26 


(Newton’s Law of Cooling) When the environmental temperature Q is not 
constant, but rather Q(t), a function of time, then Newton’s law of cooling 


becomes 
T’ =-h(T- Q(t), T(0) = To. 


This equation can be rearranged and written in the form 
T’ +hT = hQ(t), 


which is in the standard form of a first-order linear equation. The reader should 
verify that the general solution is 


t 
T(t) =Ce™ + em f hQ(s)e"*ds. 
0 


Example 1.27 


(Chemical reactor) The general equation governing the concentration C(t) 
in a chemical reactor with variable volumetric flow rates gin and qout is 


(V(e)C)’ _ GinCin me JoutC, 
where V(t) = Vo + (Gin — Gout)t is the volume of mixture in the reactor. This 
equation is linear because it can be put in the form (show this!) 
V'(t) 1 


7 —= . f 
C =F (4 + V(t) ) C — V(b) dinCin- 


Example 1.28 


(Sales Response to Advertising) The field of economics is a rich source 
of interesting phenomena modeled by differential equations. In this example 
we set up a simple model that allows management to assess the effectiveness 
of an advertising campaign. Let S = S(t) be the monthly sales of an item. 
In the absence of advertising it is observed from sales history data that sales 
decay over time. Thus $” = —aS, where a is the decay constant. To keep sales 
up, advertising is required. If there is a lot of advertising, then sales tend to 
saturate at some maximum value S = M; this is because there are only finitely 
many consumers; then M — S is the untapped market. The rate of increase in 
sales due to advertising is jointly proportional to the advertising rate A(t) and 
to the degree the market is not saturated; that is, 


ray (47). 
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The constant r measures the effectiveness of the advertising campaign. The 
term (IM —S)/M is a measure of the market share that has still not purchased 
the product. Then, combining both natural sales decay and advertising, we 
obtain the economic model 


S' = -aS + rA(t) (= =) 


M 
The first term on the right is the natural decay rate, and the second term is 


the rate of sales increase due to advertising, which drives the sales. We can 
rearrange the terms and write the equation in the form of a linear equation 


v= - (« + ae S+rA(t). (1.19) 


EXERCISES 


1. (Mixtures) Initially, a tank contains 60 gal of pure water. Then brine con- 
taining 1 lb of salt per gallon enters the tank at 2 gal/min. The perfectly 
mixed solution is drained off at 3 gal/min. Determine the amount (in lbs) 
of salt in the tank up until the time it empties. 


2. (Economics) Determine the units of the various quantities in the sales— 
advertising model (1.19) (e.g., S is measured in dollars). If A is constant, 
what is the sales equilibrium? 


3. (Technology transfer) Suppose a new innovation is introduced at time t = 0 
in a community of N possible users (e.g., a new pesticide introduced to a 
community of farmers). Let x(t) be the number of users who have adopted 
the innovation at time t. If the rate of adoption of the innovation is jointly 
proportional? to the number of adoptions and the number of those who 
have not adopted, down a DE model for x(t). Describe, qualitatively, how 
x(t) changes in time. Find a formula for x(t). 


4. (Home heating) A house is initially at 12 degrees Celsius when its heating— 
cooling system fails. The outside temperature varies according to Q(t) = 
9+10cos2zt, where time is given in days. The heat loss coefficient is h = 3 
degrees per day. Find a formula for the temperature variation in the house 
and plot it along with Q(t) on the same set of axes. What is the time lag 
between the maximum inside and outside temperature? 


5. (Economics) Let M(t) be the total amount of money a household possesses 
at time t. If they spend money at a rate proportional to how much money 


2 A quantity Q is jointly proportional to quantities A and B if Q = kAB for some 
constant k. 
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they have, and I(t) is their income, or the rate they earn money, set up a 
model for the total amount of money on hand. Assume M(0) = mo and 
show that 


t 
M(t) = moe—™ + cae I(s)e**ds. 
0 
Use l’Hospital’s rule to find the limiting of M(t) as t > oo. 


6. (Advertising) In the sales response to advertising model (1.19), assume 
S(0) = So and that advertising is constant A over a fixed time period T, 
and is then removed. That is, 


Att) = { A, 0<t<T 


0, t>T 


Find a formula for the sales S(t). Hint: Solve the problem on two intervals 
and piece together the solutions in a continuous way. 


7. (Mechanics) An object of mass m = 1 is dropped from rest at a large height, 
and as it falls it experiences the force of gravity mg and a time-dependent 
resistive force of magnitude F;. = 2u/(t + 1), where v is its velocity. Write 
an initial value problem that governs its velocity and find a formula for the 
solution. 


8. (Species migration) The MacArthur—Wilson model of the dynamics of 
species (e.g., bird species) that inhabit an island located near a mainland 
was developed in the 1960s. Let P be the constant number of species in the 
source pool on the mainland, and let S = S(t) be the number of species on 
the island. Assume that the rate of change of the number of species is 


S’=x-4, 


where x is the colonization rate and pw is the extinction rate. In the 
MacArthur—Wilson model, 


S E 
=lI{1-= d =—S. 
ver(1-8) wa paFs 
where the constants J and —& are the maximum colonization and extinction 


rates, respectively. 


a) Over a long time, what is the expected equilibrium for the number of 
species inhabiting the island? 


b) Given S(0) = So, find an analytic formula for S(t). 


c) Suppose there are two islands, one large and one small, with the larger 
island having the smaller maximum extinction rate. Both have the same 
colonization rate. Show, as expected, that the smaller island eventually 
has fewer species. 
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9. (Mortality) Let No be the number of people born on a given day (a cohort), 
and assume they die at the per capita rate m(t), where ¢ is their age. 


a) Find the number of individuals N(t) remaining in the cohort at age 
t. The fraction of the cohort that lives to age t is S(t) = N(t)/No 
and is called the survivorship function. What is the probability that a 
member of the cohort dies before age t? 


b) What is the probability of dying between the ages of t = a and t = b? 
c) The Weibull model of mortality is defined by 


nts -#E2(8). 


where po, to, and p are parameters. Find S(t) for p = 0, p = 3, and 
p = 10. Which one seems to best fit the human population? A fish 


population? 


10. (Reactors) A chemical flows into a reactor at concentration Ci, with vol- 
umetric flow rate gq. While in the reactor it chemically reacts according 
to C+ C — Products. The mixture flows out at the same rate gq. The 
governing equation for the concentration of C is (see Section 1.7) 


(VC) =qCn — gC —kVC’. 


Initially, take C(0) = Co and assume Ci, = 0. Show that this is a Bernoulli 
equation and solve it. 


11. (Parasite infections) One study on the effect of a parasitic infection on 
an animal’s immune system was carried out with the intestinal nematode 
parasite Heligmosoides polygyrus and a fixed number of laboratory mice. 
Mice were fed parasite larva at the constant rate of \ larva per mouse, per 
day. The larva migrate to the wall of the small intestine. There they die at 
per capita rate jig, and they develop into mature parasites, which migrate 
to the gut lumen, at the per capita rate of u. The mature parasites die at 
the per capita rate 6. If L = L(t) is the average number of larva per mouse, 
and M = M(t) is the average number of mature parasites per mouse, then 
the model becomes 


LT’ = - (Ho + p)L, 
M' =pL—6M. 
Initially, L(0) = M(0) = 0. First, explain the terms in the model. Then 


solve the larva equation and substitute the solution into the mature parasite 
equation to find M(t). Make generic plots of L and M vs. t. [For more 


12. 


13. 
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details regarding the experiment, the constants, and the immune response, 
see J. D. Murray, 2002. Mathematical Biology I. An Introduction, 3rd ed., 
Springer, New York, pp. 351-361.] 


(Population growth) Find the general solution of each of the two general 
forms of the logistic equation, 


nd 
. ex), 


Answers should be in terms of indefinite integrals. Hint: Bernoulli. 


(Groundwater contamination) (Brennan and Boyce 2011, p. 118) When 
chlorinated solvents, such as trichloroethylene, are spilled or dumped on a 
land surface they leach downward into subsurface groundwater and con- 
taminate it. They are denser than water and only slightly soluble, they 
remain more or less stationary in the flowing groundwater, forming a toxic 
source. As pure groundwater flows through the contamination region, it 
picks up toxic particles and carries them downstream. The diagram in Fig- 
ure 1.9 gives a visual representation of the contamination event. We assume 
the stationary contaminant source is a cube with cross-sectional area A, 
and the groundwater speed is V (called the Darcy velocity); M(t) is the 
mass of the contaminant in the source region and C(t) is the concentration 
(mass per volume) of the contaminant leaving the source region. The rate 
of change of the mass WM is given by 

dM 

dt 
The concentration C' clearly depends on M. A constitutive relation is deter- 


=-AVC. 


mined experimentally, and one common assumption is 
y\B 
la een 
where mo is the initial mass of contaminant in the source and co is the 
resulting initial source region concentration. In summary we obtain an 
equation that models the dissolution of the mass in the source region caused 
by groundwater flow: 


Finally, degradation due to biotic and abiotic processes causes decay and 
h 
we have dM 


Ta —aM® —rM. (1.20) 


a) Show a = VAco/mp. 
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Figure 1.9 Representation of a subsurface contaminant source. M is the 
total mass of contaminant in the source, C’ is the concentration of the dissolved 
contaminant leaving the source, and V is the groundwater velocity. 


b) Solve equation (1.20) with M(0) = mo in the cases (i) 8 = 1, (ii) 6 A 1. 
Note M(0) = mo. 


c) Let 0 < 6 < 1. Does the contaminant source have a finite lifetime? 
(Consider both cases, r = 0 and r > 0.) 


d) Take mp = 1620 kg, co = 100 mg/L, A = 30 m?, V = 20 m/year, 
and r = 0. Plot a graph of M(t) in the cases 6 = 2 and 6 = 0.5 for 
0 <t< 100 years. 


1.4.3 Electrical Circuits 


Modern technological society is filled with electronic devices of all types. At 
the core of these devices are electrical circuits. The simplest circuit unit is the 
loop in Figure 1.10 that contains an electromotive force (emf) E(t) (a battery 
or generator that supplies energy), a resistor, an inductor, and a capacitor, all 
connected in series. A capacitor stores electrical energy on its two plates, a 
resistor dissipates energy, usually in the form of heat, and an inductor stores 
energy in its magnetic field, which resists changes in current; we think of it as 
a coil. A basic law in electricity, Kirchhoff’s law, states that the sum of the 
voltage drops across the circuit elements (as measured, e.g., by a voltmeter) in 
a loop must equal the applied emf. In symbols, 


Vi_+VrRt+Vo= E(t). 


This law comes from conservation of energy in a current loop, and it is derived 
in elementary physics and engineering texts. A voltage drop across an element 
is an energy potential that equals the amount of work required to move a charge 
across that element. 
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Figure 1.10 An RCL circuit with an electromotive force E(t) supplying the 
electrical energy. 


Current in a circuit is analogous to water flowing in a pipe. In this water 
analogy, the voltage drop is the difference in water pressure between two points 
along the pipe (measured by a pressure meter, say), and particularly the pres- 
sure drop across an element. Water flowing in the pipe is measured as the rate 
that water passes a fixed point. A resistor is like a mesh in a pipe, taking more 
energy to push water through it. A capacitor is like a tank that stores water, 
and an inductor is like a water wheel at a old mill, which because of its inertia, 
resists changes in its angular velocity when the water flow is increased. There 
are enlightening articles on the internet about the electrical—water analogy. 

Let J = I(t) denote the current (in amperes, or charge per second) in the 
circuit, and let Q = Q(t) denote the charge (in coulombs) on the capacitor. 
These quantities are related by 


Q’ =I. 


By Ohm’s law the voltage drop across the resistor is proportional to the 
current, or 


Vr = RI, 


where the proportionality constant R is called the resistance (measured in 
ohms). The voltage drop across a capacitor is proportional to the charge on 
the capacitor, or 


where C is the capacitance (measured in farads). Finally, the voltage drop 
across an inductor is proportional to how fast the current is changing, or 


Vz, = LI’, 


where L is the inductance (measured in henrys). This is Faraday’s law. Sub- 
stituting these voltage changes into Kirchhoff’s law gives 


LI'+ RI+ a@ = E(t). 
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input output 


E® system 


O10) 
Figure 1.11 An input-output system. 


or, using Q’ = TJ, 
1 
LQ" + RQ! + GQ = E(t). (RCL circuit) (1.21) 


This is the RCL circuit equation, which is a second-order differential equa- 
tion for the charge Q = Q(t) on the capacitor. The initial conditions are 


OO =a5. (0) = 110) =a: 


These initial conditions express the initial charge on the capacitor and the 
initial current in the circuit. Here, E(t) may be a prescribed constant (e.g., 
E(t) = 12 for a 12-volt battery) or it may be a oscillating function of time t 
(e.g., E(t) = Acoswt for an alternating voltage potential of amplitude A and 
frequency w). 

Equation (1.21) can be written in terms of the current I as 


1 
LI" + RI + 5I=E'). 


Equation (1.21) is a second-order equation and is examined in Chapter 2. 
However, if there is no inductor in the circuit, then the resulting RC circuit is 
modeled by the first-order equation 


RQ! + 5Q = Eli). (RC circuit) 


If E(t) is constant, for example for a battery, this equation can be solved using 
separation of variables. Otherwise, we must divide the equation by R to put 
into the standard form of a linear equation, 


beget 


which can be solved using integrating factors. 

From an engineering perspective, circuits illustrate a systems view of prob- 
lems. Regarding the RC circuit as a system, we input the voltage source E(t) 
and get the charge Q(t) as the output. This is illustrated in Figure 1.11. 
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Example 1.29 
Let R= 1; C = 1/2, and Q(0) = 0, with an emf given by 


1, O0<t< 2, 
BW ={ 0, t>2. 


For ¢t < 2 the circuit equation is Q{ + 2Q1 = 1, and for t > 2 the equation is 
Q5 + 2Q2 = 0. These have solutions 


Q(t) =>) (1 ve er) ’ t< 2, Qa(t) = Ae~*, t> 2, 


respectively, where the initial condition has been applied to the Q; equation; A 
is an arbitrary constant. Because the solution is continuous, we impose Q (2) = 
Q2(2), which gives A = (1/2)(e4 — 1). So 


3 (l-e7**) O<t<2 
= 2 ? pa ee | 
BW) ={ I(t —1)e, 43.2. 


EXERCISES 


1. Write the equation that governs an RC circuit with a 12-volt battery, taking 
R=landC= 4. Determine the equilibrium solution and its stability. If 
Q(0) = 5, find a formula for Q(t). Find the current I(t). Plot the charge 


and the current on the same set of axes. 


2. An aging battery generating 200e~*' volts is connected in series with a 


20 ohm resistor, and a 0.01 farad capacitor. Assuming q = 0 at ¢t = 0, 
find the charge and current for all t > 0. Show that the charge reaches a 
maximum and find the time it is reached. 


3. In an arbitrary RC circuit with constant emf FE’, use the method of sepa- 
ration of variables to derive the formula 


Q(t) = Ae~/FE + BC 


for the charge on the capacitor, where A is an arbitrary constant. If Q(0) = 
Qo, what is A? 


4. An RCL circuit with an applied emf given by E(t) has initial charge Q(0) = 
Qo and initial current [(0) = Ip. What is I’(0)? Write the circuit equation 
and the initial conditions in terms of current I(t). Hint: Use Kirchhoft’s 
law in the form LI’ + RI + Q/C = E(t). 


5. Write the RCL circuit equation with the voltage V(t) on the capacitor as 
the unknown state function. 
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Formulate the governing equation of an RCL circuit in terms of the current 
I(t) when the circuit has an emf given by E(t) = Acoswt. What are the 
appropriate initial conditions? 


Find the DE model for the charge in an LC circuit with no emf. Show that 
the response (or, solution) of the circuit can have the form Q(t) = Acoswt 
for some amplitude A and frequency w, both of which are determined in 
terms of the circuit parameters D and C. 


Consider a standard RCL circuit with no emf, but with a voltage drop 
across the resistor given by a nonlinear function of current, 


Let 
Ve=-(-P =I). 
n= 3(5"~1) 


Such a resistor is called an active resistor, in contrast to Ohm’s law, which 
describes a passive resistor. If C = L = 1, find a second-order differential 
equation for the current I(t) in the circuit. 


Use separation of variables to solve the following problems. Write the solu- 
tion explicitly when possible. 

a) x’ = p(t)x, where p(t) is a given continuous function. 

b) «’ =—2tx, x(1) = 2. Plot the solution on 0 <t < 2. 


c) Let 
, f —2a, 0<t<l 
sae ee ae ees 2 


with «(0) = 5. Find and plot a continuous solution on the interval 
0<t<2. 


1.5 One-Dimensional Dynamical Systems 


So far we focused on setting up and solving differential equations with the goal 
of finding an analytical solution or formula. In this section we take a qualitative 


approach and see how important information can be obtained using geometric 


methods. Often, in science and engineering, qualitative methods give all the 


information we need to understand the problem without deriving detailed and 


complicated formulas. 


Many applications lead to differential equations that have no explicit time 


dependence; that is, the rate of change depends only on the state « = z(t). 
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x =x(A) 
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Figure 1.12 The phase line. A one-dimensional state space x where the state 
of the system 2 = x(t) moves as t changes. Arrows on the line represent the 
direction of motion, as shown. 


Such an equation has the form 


dx 
dt = Gs), 


with no explicit time dependence t on the right side. (Of course, the state itself 
x is time dependent.) Such equations are called autonomous. A common 
representation of a solution 7 = z(t) is a time series plot of « versus t in the 
two-dimensional tz plane. But here we interpret a solution as a state x moving 
along a one-dimensional line, the x axis. See Figure 1.12. The x axis is a state 
space called the phase line. Think of a particle of mass m moving on the 
x axis, which is the position of the particle. For comparison, in multivariable 
calculus we regard the motion of a particle moving in the xy plane along a given 
trajectory, for example, counterclockwise movement on a circle 2? +y? = R? of 
radius R. That is an important piece of information even though we may not 
know the explicit parametric equations z = x(t), y = y(t) of the trajectory. We 
give up knowledge of time dependence and focus on directions. 


1.5.1 Autonomous Equations 


Example 1.30 


(The Logistic Law) In animal populations we do not expect exponential 
growth over long periods of time as predicted by the Malthus law where the 
relative growth rate 2’ /x = r remains constant as the population «x increases. 
Environmental factors such as competition for resources limit the population 
as it gets large. Therefore we expect the relative growth rate r to decrease as x 
gets large. The simplest assumption is that the relative growth rate decreases 
linearly as a function of population, and the rate becomes zero at some max- 
imum carrying capacity kK. See Figure 1.13. This is the logistic model of 
population growth, developed by P. Verhulst in the 1800s. Quantitatively, 


/ 


—=r(i-=) or a =re(1-=). (1.22) 


We can write this autonomous equation in the form 


" 
ag =rx— 2’. 
K 
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Figure 1.13 Plots of the logistic model of population growth. The left plot 
shows the relative growth rate versus population, and the right plot shows the 
growth rate versus population. Either plot gives an important interpretation of 
the model. Where the growth rates are above the axis, the population increases; 
when either is below the axis, the population decreases. 


The first term is a positive growth term, which is the Malthus term. The sec- 
ond term, which is a negative quadratic in x, decreases the population growth 
rate and is the competition term. The latter is a reasonable model because if 
there were x animals, then there would be about x? 
petition term is proportional to the number of possible encounters. For any 
initial condition (0) = xo we can find the formula for the solution to the logis- 
tics equation (1.22) using separation of variables. However, qualitative features 
of solutions can be exposed without actually finding it. We often seek only 
qualitative features of a model. We note there are two constant solutions to 
(1.22), 


encounters; so the com- 


x(t) =0, a(t) =K (equilibrium solutions) 


corresponding to no animals (extinction) and corresponding to the number of 
animals at the carrying capacity K. These constant solutions are found by 
setting the right side of the growth equation equal to zero (because that forces 
x’ = 0, or x = constant. Constant solutions to an autonomous equations are 
called steady-state, or equilibrium, solutions. Further: 


1. If the population is between x = 0 and x = K then the right side of (1.22) 
is positive, giving x’ > 0; for these population numbers, the population is 
increasing. 


2. If the population is larger than the carrying capacity K, then the right side 
of (1.22) is negative, giving x’ < 0, and thus the population is decreasing. 
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These facts can be represented geometrically on a plot of the growth rate 
x’ versus the population x as shown in Figure 1.13. The key properties can 
be represented conveniently on a phase line plot as shown in Figure 1.14. 
We first plot the growth rate x’ versus x, which in this case is a parabola 
opening downward (Figure 1.13). The points of intersection on the x axis are 
the equilibrium solutions x* = 0 and «* = K. We then indicate by a directional 
arrow on the x axis those values of x where the solution «(t) is increasing (where 
x’ = f(x) > 0 ) or decreasing (x’ = f(x) < 0). The arrow points to the right 
when the graph of the growth rate f(x) is above the axis, and it points to 
the left when the graph is below the axis. We view the phase line as a one- 
dimensional, parametric solution space with the population « = x(t) tracing 
out points on that line as t increases. In the range 0 < x < K the arrow points 
right because x’ > 0. So «(t) increases in this range. For « > K the arrow 
points left because x’ < 0. The population x(t) decreases in this range. Most of 
the time, rather than draw the phase line directly below the plot of the growth 
rate, as shown, we just draw the arrows on the x axis of the growth rate plot. 

These qualitative features can easily be transferred to approximate time 
series plots (see Figure 1.15) showing x(t) versus t for different initial conditions. 


Both the phase line and the time series plots imply that, regardless of the 
initial population (if nonzero), the population approaches the carrying capacity 
K. This equilibrium population «* = K is called a stable equilibrium. The 
zero population «* = 0 is also an equilibrium population; but, near zero we have 
x’ > 0, and so the population diverges away from zero. We say the equilibrium 
population z* = 0 is an unstable equilibrium. Because we consider only 
nonnegative populations, we ignore the fact that « = 0 could be approached 
on the left side. In summary, this simple geometrical analysis determines the 
complete qualitative structure of the logistic population model. 


Example 1.31 


(Motion in a Fluid) Suppose a particle of mass m is falling downward through 
a viscous fluid. There are two forces on the particle, gravity and fluid resistance. 
If we measure positive distance downward from the top of the fluid surface, 
the gravitational force is mg and is positive because it acts on the mass in 
the positive downward direction; the resistive force is —av?, and it is negative 
because it opposes positive downward motion. The net external force is then 
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S 


ca 


growth rate 


Figure 1.14 The z axis is the phase line on which arrows indicate an increas- 
ing or decreasing population for certain ranges of x. 


x 
x’<0 (decreasing) 
K \nns 
equilibria 
x’ >0 (increasing) / 
0 t 


Figure 1.15 Time series plots of solutions to the logistics equation for various 
initial conditions. For 0 < x < K the population increases and approaches K, 
whereas for z > K the population decreases to K. If «(0) = K, then z(t) = Kk 
for all times ¢ > 0; this is the equilibrium solution. 


F = mg — av”, and the equation of motion, from Newton’s second law, is 
mu’ = mg — av. 

If we impose an initial velocity, v(0) = vo, then the differential equation and 

initial condition give an initial value problem for v = v(t) which can be solved 

by separation of variables. 

As in the last example we can obtain important qualitative information from 
the DE itself, without solving. Over a long time, assuming the fluid is deep, 
we would observe that the falling mass would approach a constant terminal 
velocity vr. Physically, the terminal velocity occurs when the two forces, the 
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stable 


Vv 


Figure 1.16 A phase line plot for the model v’ = g — (a/m)v?. For v < vr 
the velocity is increasing because v’ > 0; for v > vr the velocity is decreasing 
because vu’ < 0. All the solution curves approach the equilibrium solution, which 
is the constant terminal velocity v(t) = vr. 


gravitational force and resistive force, balance, thus giving v’ = 0, or 
g — (av2./m) = 0. Therefore, 

mg 

UT = =—, 

a 
Note that u(t) = vr is the constant, or equilibrium, solution of the differential 
equation. Regardless of the initial velocity, the system approaches this equilib- 
rium state. This supposition is supported by the observation that v’ > 0 when 
uv < vp and vu’ < 0 when v > vr. Figure 1.16 shows the phase line diagram 
indicating the approach to equilibrium. 


General Discussion. Qualitative methods can be used to examine any 
autonomous equation, 

x’ = f(x). (1.23) 
An equilibrium solution of (1.23) is a constant solution x(t) = «* for all 
t. Clearly, those solutions have zero derivative and therefore must be roots of 
the algebraic equation f(x) = 0. Thus, if x(t) = 2* is an equilibrium, then 
f(a*) = 0, and conversely. The roots of f(a) = 0 can be regarded as points on 
the x axis, and therefore we call them critical points of f. We usually make no 
distinction between a critical point and the corresponding equilibrium solution. 
Critical points are the values where the graph of f(a) versus x intersects the x 
axis. We always assume the critical points are isolated; that is, if x* is a critical 
point, then there is a small open interval containing x* that contains no other 
critical points. Figure 1.17 shows a generic plot where the critical points are 
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x* =a, b,c. In between the equilibria we can note the values of x for which the 


population is increasing (f(x) > 0) or decreasing (f(x) < 0). We place arrows 
on the phase line, or the z-axis, in between the critical points showing the 
direction of the movement (increasing or decreasing) of x(t) as time increases. 
If desired, the information from the phase line can be translated into time 
series plots of x(t) versus t (Figure 1.18). In between the constant, equilibrium 
solutions, the other solution curves increase or decrease; clearly, oscillations 
are not possible. Moreover, assuming f is a well-behaved function (f’(x) is 
continuous), solution curves actually approach some equilibria, getting closer 
and closer as time increases. Because solutions are unique (Section 1.5.3), two 
solution curves can never intersect. 
x! A 

graph of 
F(x) 


stable unstable unstable 


Figure 1.17 A generic phase line diagram showing f(x), which is x’ versus 
xz. The points of intersection, a, b, c, on the z-axis are the equilibria, or critical 
points. The arrows on the z-axis, which is the phase line, show how the state x 
changes with time between the equilibria. The direction of the arrows is easily 
read from the plot of f(x) vs. x. They are to the right when f(x) > 0 and to 
the left when f(x) < 0. 


On the phase line (x axis), if arrows on both sides of a critical point toward 
that critical point, then we say the critical point, or equilibrium, is stable, or 
sometimes asymptotically stable. If both of the arrows point away, the critical 
point or equilibrium is unstable. If a direction arrow on one side of a critical 
points is directed toward the the critical point, and on the other side it is 
directed away, or vice-versa, then we say the critical point is unstable; some 
authors use the term semi-stable. 

Our interpretation is this. If a system is in a stable equilibrium and given 
a small perturbation (i.e., a small change, or “bump” ) moving it to a nearby 
state, then the system returns to that state as t ~ +00. Specifically, consider 
a population of fish in a lake that is in an stable state x*. A small death event, 
say caused by some toxic chemical that is dumped into the lake, will cause the 
population to drop. Stability means that the system will return the original 
state x* over time. At an unstable equilibrium, a small perturbation can cause 
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0 = 

Figure 1.18 Time series plots corresponding to Figure 1.17 for different initial 
conditions. The constant solutions are the equilibria. The equilibrium x = a is 
stable—if the system is in that state and given a small perturbation away from 
that state, the system will return to x = a. Both x = b and x = c are unstable 
equilibria. 


the system to approach a different equilibrium or even go off to infinity. In 
the logistics model for population growth we observed that « = K is stable; 
if a small change from the carrying capacity occurs, the system will return to 
x = Kk. The zero population x = 0 is unstable; a small perturbation to zero will 
cause the number of fish to grow and approach the carrying capacity « = K as 
t— o. 

It is important to note that when we say an equilibrium x* is stable, we 
understand it is with respect to small perturbations, or in a local sense. A more 
precise definition of stability can be given as follows. An isolated equilibrium 
state x* of (1.23) is locally stable if there is an open interval I containing «* 
with lim:.+4.. x(t) = 2* for any solution « = x(t) of (1.23) with x(0) in J. That 
is, each solution starting in J converges to x”*. 

If a perturbation is not small, there is no guarantee that the system returns 
to the original stable state x*. For example, a catastrophe or bonanza in a fish 
population could cause the population to jump beyond some other equilibrium. 
If the population returns to the state x* for all perturbations, no matter how 
large, then the state x* is called globally stable. 


Analytic Criterion. We can write a simple analytic criterion for stability of an 
equilibrium. From the phase line plot, if x* is an equilibrium and the derivative 
f'(2*) <0 (f(x) is decreasing), then the pattern of arrows on the phase line is 
that of a stable equilibrium, both pointing toward «*. Similarly, if f’(a*) > 0 
(f(a) is increasing) then the arrows on the phase line point away from x*, and 
the equilibrium is unstable. If f’(a*) = 0, then all patterns are possible and the 
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equilibrium may be stable or unstable. In this latter case the concavity of f(z) 
at x*) comes into play and we must examine the second derivative to determine 
concavity. We summarize this discussion in the following: 


Theorem 1.32 


Let x* be an isolated critical point, or equilibrium, for the autonomous equation 


dx 

a f(x). 
If f’(a*) < 0, then x* is stable; if f’(2*) > 0, then a* is unstable. If f’(x*) = 0, 
then there is no information about stability. In this case we analyze higher 
derivatives. 


Example 1.33 


(Logistic Equation) Consider the logistics equation x’ = f(a) = ra(1—2/K). 
The equilibria are x* = 0 and x* = K. The derivative of f(a) is 


f'(a) =r —2ra/K. 
Evaluating the derivative at the equilibria gives 


f(O)=r>0, f'(K)=-r <0. 


Therefore x* = 0 is unstable and «* = K is stable. 


In summary, an autonomous model can be quickly and easily analyzed qual- 
itatively without finding the solution. All we do is plot f(x) versus x, and then 
identify on the phase line the equilibria and their stability properties. 


Remark 1.34 


For autonomous equations of the form 2’ = F(x) — G(«), where the right side 
cannot be factored, we can find the equilibria graphically by plotting F(a) 
versus x and G(x) versus x on the same set of axes. The points x* where the 
graphs cross, i.e., where F'(x*) = G(a*), are the equilibria. Where F(x) > G(2), 
the state z = x(t) is increasing, and where F(x) < G(x), the state x = x(t) is 
decreasing. 
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EXERCISES 


1. A fish population in a lake is harvested at a constant rate, and it grows 
logistically. The growth rate is 0.2 per month, the carrying capacity is 40 
(thousand), and the harvesting rate is 1.5 (thousand per month). Write the 
model equation, find the equilibria, and classify as stable or unstable. Will 
the fish population ever become extinct? What is the most likely long-term 
fish population? 


2. For each of the following models: (a) plot the growth rate f(x) versus x 
and sketch the phase line diagram; (b) find the equilibria analytically and 
classify them according to their stability using Theorem 1.32; (c) draw a 
few key time series plots, x = x(t) in the ta plane. 


a) a! = 27(2—2). f) a! = 2a(1— 2) — $2. 

b) af = a(4—2)(5 —a)?. g) a! = (4—2)(2—2)8. 

c) a! = (@—1)e-*. h) a! = «@?(5 —a)?(@ — 10). 
d) a’ = a(x —8)3. i) 2! = —(1+ 2)(2? — 4). 
e) a! = 2x —7. j) 2’ =coshz — 1. 


3. Use analytical or graphical methods to determine equilibria for each of the 
following differential equations: 


a) a! =(1—2)(1-e-**). c) R= oe —1. 
b) y’ =y* (1— ye7%), a>0. d) z= oy — Inz. 


4. (The Allee effect) At low population densities it may be difficult for an 
animal to reproduce because of a limited number of suitable mates. A 
population model that predicts this behavior is the Allee model (W. C. 
Allee, 1885-1955) 


P P 
pi=rp (2-1) (1-3). 0<a<K. 
a 


(a) Find the growth rate P’ versus P and sketch the phase line diagram. 
(b) Determine the equilibrium populations analytically. (c) Classify the 
equilibria with respect to stability. (d) Describe the long time behavior of 
the system for different initial populations. (e) Comment on the meaning 
of the model. 
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5. Consider the autonomous DE 


d 
Gr = (2? ~ 36)(a—2)?, 
where a > 10 is a constant. (a) Draw the phase line diagram. (b) Sketch 


an approximate graph of the solution curve x = x(t) satisfying x(0) = 8. 


(Heat transfer) Heat transfer by radiation from a body to its surroundings 
is modeled by the Stefan—Boltzmann law 


a 

ae 
where T = T(t) is the absolute temperature of the body and S is the 
temperature of the surroundings. k is a physical parameter depending on 
the body. (a) Draw a phase line diagram and comment on the nature of 
the solution. (b) Let T(0) = 2000K and S = 300K. Since S is much 
smaller than T we can neglect the term S in the equation. Taking k = 
2.0 x 10-!*K~3/sec, find an approximate solution in this case and plot the 
result. 


—k(T*— S*), 


(Harvesting) One can modify the logistic population model to include har- 
vesting (e.g., hunting) of animals. That is, assume that the animal popula- 
tion grows logistically while, at the same time, animals are being removed 
(by hunting, fishing, or whatever) at a constant rate of H animals per unit 
time. The model is 


= 1-2) -H, 
just 


a) Choose new independent and dependent variables, 7 = rt and « = 
p/K, and show that the model can be written in the form 


re oe) 


rs 


where h is a constant. 


Ale 


b) Using the simplified model, determine the equilibria in the case h > 
c) Determine the stability of the equilibria. 


d) Explain how the population varies for different initial conditions. Does 
the population ever become extinct? 


. (Life history) In this exercise we introduce a simple model of growth of 


an individual organism over time. For simplicity, we assume it is shaped 
like a cube having sides equal to L = L(t). Organisms grow because they 
assimilate nutrients and then use those nutrients in their energy budget for 
maintenance and to build structure. It is conjectured that the organism’s 
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growth rate in volume equals the assimilation rate minus the rate food is 
used. Food is assimilated at a rate proportional to its surface area because 
food must ultimately pass across the cell walls; food is used at a rate 
proportional to its volume because ultimately cells are three-dimensional. 
Show that the differential equation governing its size L(t) can be written 


L'(t)=a—DdL, 


where a and 0 are positive parameters. What is the maximum length the 
organism can reach? Use separation of variables to show that if the length 
of the organism at time t = 0 is L(0) = 0 (it is very small), then the length 
is given by L(t) = (a/b)(1—e~"). Does this function seem like a reasonable 
model for growth? 


9. (Pest outbreaks) In a classical ecological study of budworm outbreaks in 
Canadian fir forests, researchers proposed that the budworm population N 
was governed by the law 


N=rN (1 = x) — P(N), 


where the first term on the right represents logistics growth, and where 
P(N) is a bird-predation rate given by 


aN? 


PN) = 3 


a) Sketch a generic plot of the bird-predation rate P(V) versus N. 


b) What are the dimensions of all the constants and variables in the 
model? 


c) Define new dimensionless independent and dependent variables by 


t N 


=_-_ n — 
b/a’ b’ 
and reformulate the differential equation in terms of those variables 
and certain dimensionless constants. (For this problem, a dimensionless 
form is extremely tractable compared to the dimensioned model.) 


d) Working with the dimensionless equation, show that there is at least 
one and at most three positive equilibrium populations. What can 
be said about their stability? Hint: Write the equation in the form 
dn/dt = nF(n) and plot the two terms of F'(n) to find their intersec- 
tion points. 
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10. 


11. 


12. 


13. 


14. 


1. First-Order Differential Equations 


(Epidemics) In a fixed population of N individuals let I = I(t) be the 
number of individuals infected by a certain disease and let S = S(t) be the 
number susceptible to the disease with I(t) + S(t) = N. Assume that the 
rate that individuals are becoming infected is proportional to the number of 
infectives times the number of susceptibles, or J’ = aSI, where the positive 
constant a is the disease transmission coefficient. Assume no individual 
gets over the disease once it is contracted. If (0) = Jp is a small number 
of individuals infected at t = 0, formulate an initial value problem for the 
number infected I(t) at time t. Explain how the disease evolves. Over a 
long time, how many individuals in the population contract the disease? 
This type of disease, where no one recovers, produces an SI model. 


(Epidemics) With the same notation as in the previous problem, suppose 
that infected individuals recover from the illness at the per capita rate r 
and then become susceptible again. This produces an SIS model. Argue 
that the governing equations are 


S’=-aSI+rli, I’ =aSI—-rl, 


where J+ S = N, and formulate a differential equation for the number 
of infectives I(t). Explain how the disease evolves from a small number of 
infectives and determine how many have the disease after a long time. 


(Dynamics) The dynamical equation x’ = f(x) is said to have a potential 
function V(a) if V(x) = —f(x). Show that x* is an equilibrium for the 
equation if, and only if, V’(a@*) = 0. On any solution x = z(t) of 2’ = f(x), 
show that V(|z(t)|) is strictly decreasing in time. 


(Economics) In a model of price adjustment, the price per item P = P(t) 
of a commodity is proportional to the difference between the demand D 
for the quantity and the quantity S that is supplied, or 


dP 

— =a(D—S). 

rie ) 

If the supply is proportional to the price and the demand is inversely pro- 
portional to the price, set up a DE model for the price P and explain the 
reasoning behind the assumptions. Investigate the dynamics of the system, 
and find a formula for P(t) if P(O) = po. 


A function V = V (a) is called a potential energy function for the autonomous 
equation 2’ = f(x) if f(z) =—V'(z). (a) Show that if « = x(t) is any non- 
constant solution to x’ = f(a), then V(a(t)) is a strictly decreasing function 
of t. (b) Show that if x* is a critical point of 2’ = f(x) and V(z) has a 
local minimum at x*, then «* is stable. 
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1.5.2 Bifurcation 


Differential equations almost always contain one or more parameters. It is 
of great interest to determine how equilibrium solutions depend upon those 
parameters and how the stability of an equilibrium behaves as the parame- 
ters change. It is observed that as the parameter slowly changes, there can be 
abrupt changes in stability of a steady state; stability can be lost or gained, 
and even the single equilibrium can split into two equilibria. A simple thought 
experiment can illustrate the phenomenon. Imagine a thin metal vertical rod 
standing upright on a table and a constant force fF pushing downward on the 
top end of the rod. If F is small, nothing happens—the rod remains in its sta- 
ble, vertical equilibrium. But as F' is increased slowly, there is a value F* when 
the rod buckles, moving it to a entirely different orientation. This phenomenon 
is called bifurcation, which means dividing or splitting. 
Consider a quantitative example. The logistic equation 


Ja (1 _ P) 
dt K 
has two parameters: the growth rate r and the carrying capacity kK. Let us add 
harvesting; that is, we remove animals at a constant rate H > 0. We can think 
of a fish population where fish are caught at a given rate H. Then we have the 
model 
a = rp (i- 2) = of (1.24) 
We now ask how equilibrium solutions and their stability depend upon the rate 
of harvesting H. 
There are three parameters in the problem, but we can simplify it using the 
new independent variables 7 and x defined by 


This amounts to measuring the population relative to the carrying capacity 
and time relative to the inverse growth rate. In terms of these new variables, 
(1.24) simplifies to (check this!) 


dx 

—=r7(1-—2)-h 

= = a(1-2) -h, 

where h = H/rK is a single parameter representing the ratio of the harvesting 
rate to the product of the growth rate and carrying capacity. We can now study 
the effects of changing h, a reduced harvesting parameter, to see how harvesting 
influences the steady-state fish populations in the model. 


68 1. First-Order Differential Equations 


7 n<1/4 
i! 1 a 
| 1 
! 1 
! 1 
| 1 
! I 
| I 
! 1 
1 
phase i Si 
line + > 
unstable stable x 


Figure 1.19 Plot of the phase line diagram f(x) = «(1 — x) — h for a fixed 
ee oe 


The equilibrium solutions depend on fA and are roots of the quadratic equa- 
tion 
f(z)=a(1-a2)-h=0, h>O, 


which are given by 
1 1 


x => 3 Pn 5Y 1 — 4h. (1.25) 
If h < } there are two positive equilibria. The graph of f(x) in this case is 


concave down and the phase line shows that the smaller one is unstable, and 
the larger one is stable. (See Figure 1.19.) Notice, however, as h increases these 
two equilibria begin to come together, and at h = + there is only a single 
unstable equilibrium at 7* = 4. For h > + the equilibrium populations cease 
to exist. In summary, when harvesting is small, there are two equilibria, one 
being stable; as harvesting increases the equilibrium disappears. We say that 
a bifurcation occurs at the value h = i. This is the value where there is a 
significant change in the character of the equilibria. For h > + the population 
becomes extinct, regardless of the initial condition because f(a) < 0 for all a. 
All these facts can be conveniently represented on a bifurcation diagram. 
See Figure 1.20. On a bifurcation diagram we plot the equilibrium solutions 
x* versus the parameter h as given in (1.25). In this context, h is called the 
bifurcation parameter. A plot of (1.25) is a parabola opening to the left. 
We observe that the upper branch of the parabola corresponds to the larger 
equilibrium (with the plus sign), and all solutions represented by that branch 
are stable; the lower branch, corresponding to the smaller solution (with the 
minus sign), is unstable. 

In summary, if harvesting is small there is a stable and an unstable equilib- 
rium; Nature usually selects out the stable one. As harvesting slowly increases, 


1.5 One-Dimensional Dynamical Systems 69 


1 stable 


1/4 h 


Figure 1.20 Bifurcation diagram: plot of the equilibria as a function of the 
bifurcation parameter h, x* = at sV1—4h . For h > + there are no equilibria 
and for h < + there are two, with the larger one being stable and the smaller 
one unstable (dashed). A bifurcation occurs at h = 4. 


the two equilibria coalesce and at a critical value of h, the bifurcation point, 
the fish population dies out due to excessive removal by harvesting. 


Example 1.35 


Consider the simple equation 


az’ = a(h— <x”), 


where h is a real parameter. The equilibria are «* = 0 for all h, and «* =+WVh 
when h > 0. The bifurcation diagram, plotting the equilibria x* as functions of 
h, is shown in Figure 1.21. Notice that for h > 0 there are three equilibria, and 
for h < 0 there is just one. Therefore, if h is slowly increased from a negative 
number, at h = 0 a bifurcation occurs and the single equilibrium splits into 
three equilibria; the «* = O equilibrium changes stability at the bifurcation 
point and two stable equilibria appear. 

We can apply Theorem 1.32 to check stability of the different branches of 
the bifurcation diagram. We compute f’(x), which will of course depend on h: 


f'(z) =h— 32. 
Observe that 
f'(0) =h. 


Thus, z* = 0 is stable if h < 0 and unstable if h > 0. In other words, the 
equilibrium «* = 0 changes stability at h = 1. Next, 


f'(tVh) =h—3h =—2h. 
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x* 


stable 


stable _unstable ip 


Figure 1.21 Bifurcation diagram: plots of x* versus h. For obvious reasons, 
this is called a pitchfork bifurcation. 


For positive h both branches, x* = +Vh, are stable. As an exercise, the reader 
can sketch the phase line diagram for h > 0 and h < 0 and observe that at 
h =0 there is a dramatic change in the diagram. 


Notation. When we use prime to denote the derivative, we have to be 
careful to understand what the prime means. For example, f’(a) means the 
derivative of f with respect to x, whereas a prime on x means a time derivative 
because x = x(t) is a function of time. We almost always know from context 
about what derivative we are taking. If there is confusion, we write out the 
derivative more specifically, such as df /dx or dx/dt. 


EXERCISES 


1. The following models contain a parameter h. For each model: (a) find the 
equilibria in terms of h and determine their stability using Theorem 1.32, to 
the extent possible. (b) Construct a bifurcation diagram showing how the 
equilibria depend upon h; label the branches of the curves in the diagram 
as unstable or stable. 


a) o' =h—2?. d) a’ = (1—2)(2?—h). 
b) a’ = (a —1)(a —h). e) a! = (24 — Vh)(3 — Az). 
c) y' =hy—y’. f) yf =—(1+ y)(y? — h?). 


2. Consider the differential equation 


dx x 
dt «v%+1° 
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Use the analytic criterion in Theorem 1.32 to investigate the stability of 
x= 0. 


3. Consider the model y’ = (A — 1)y — y?, where A is a parameter. 


a) Explain what is meant by the statement “As » increases through 1, 
the stable solution y = 0 bifurcates into 2 stable solutions.” 


b) Sketch a bifurcation diagram showing how the equilibria vary with X. 
Label each branch of the curves shown in the bifurcation diagram as 
stable or unstable. 


4. The biomass P of a plant grows logistically with intrinsic growth rate r 
and carrying capacity kK. At the same time it is consumed by herbivores 


at a rate 
aP 


b+ P’ 


per herbivore, where a and 6 are positive constants. The model is 


P\ aPH 
PagPlis js. 
rp ( 7) b+P’ 


where H is the biomass of herbivores. Assume aH > br, and assume r, K, 
a, and 0 are fixed. Plot, as a function of P, the growth rate (first term) 
and the consumption rate (second term) for several values of H on the 
same set of axes, and identify the values of P that give equilibria. What 
happens to the equilibria as the herbivory H is steadily increased from 
a small value to a large value? Draw a bifurcation diagram showing this 
effect. That is, plot equilibrium solutions versus the parameter H. If the 
herbivory is slowly increased so that the plants become extinct, and then 
it is decreased slowly back to a low level, do the plants return? 


5. A deer population grows logistically and is harvested at a rate proportional 
to its population size. The dynamics of population growth is modeled by 


P 
Plarp (1-2) -nr 


where h > 0 is the harvesting rate. Use a bifurcation diagram to explain 
the effects on the equilibrium deer population when h is slowly increased 
from a small value to a large value. 


6. Draw a bifurcation diagram for the model 2’ = x? — x + h, where h is 
a parameter. Label branches of the curves as stable or unstable. (Such a 
model is called a hysteresis model.) Hint: Graph h versus x and rotate the 
plot. 
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10. 


11. 


1. First-Order Differential Equations 


Consider the model u’ = u(u — e*”), where \ is a parameter. Draw the 
bifurcation diagram, plotting the equilibrium solution(s) u* versus X. Label 


each curve on the diagram as stable or unstable. Hint: Graph versus u. 


Consider the differential equation x’ = ax? — 1, —oo < a < +00, where a 
is a parameter. Draw the bifurcation diagram and indicate stability of the 
various branches. 


Consider the differential equation y’ = 6b — ev where 0 is a positive 
parameter. Draw the bifurcation diagram and indicate the stability of the 
equilibrium. 


The phosphorus concentration P = P(r) at time 7 in a small lake is mod- 


eled by 
dP Pe 


ae I-—sP+ ay ars 
Here, J is the input rate, often caused by runoff and leaching of fertilizer 
from local farms, s is the rate of sedimentation and outflow, and the last 
term is the rate of recycling of phosphorus from the sediment; M and 
nm are positive constants, and n is generally large. If P is large, the lake 
becomes putrid with algae overgrowth, a condition called eutrophication. 
It is observed that onset of eutrophication occurs quickly as the inflow 


increases. 
a) Introduce new, dimensionless, independent and dependent variables 
t = st, p= P/M and derive the simplified model 


nm 


dp Dp 
+p’ 


a ee 


(1.26) 


where a and p are appropriately defined constants. 


b) Take n = 8 and p = 5. Graphically determine the equilibrium concen- 
trations as the inflow a varies from 0.25 to 0.75, and explain the rapid 
onset of eutrophication. Hint: Plot p— a and pp"/(1 +p”) versus p 
on the same set of axes and observe how the number of equilibria, or 
intersections, change as a increases, or the line p— a moves downward. 


c) Draw the bifurcation diagram, plotting the equilibria versus a. Label 
the stability of the branches. 


(Thermistors) A thermistor is a resistor that depends on temperature; as 
it gets hotter, the resistance increases. They are used in fuses and electrical 
appliances to prevent overheating. If a constant voltage V is applied across 
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a thermistor and its temperature T depends only on time, then the energy 
balance applied to the thermistor leads to the model 
y2 
R(T) 
where m is its mass, c is the specific heat, h is the heat loss coefficient, T. 
is the environmental temperature, and R(T) is the resistance. 


mcT’ = 


= A(T = Te), 


a) Derive the model equation. Hint: Use Newton’s law of cooling and the 
ohmic heating. 


b) If R(Z) is a positive increasing function, show that there is a unique 
equilibrium temperature. 


1.5.3 Existence of Solutions 


We defined an initial value problem for a first-order differential equation as 
the problem oe 
= J (tse) 
(IVP) { a= ais (1.27) 
Geometrically, solving an initial value problem means determining a solution 
that passes through a specified point (to, 20) in the ta plane. 
There are many interesting mathematical questions about initial value prob- 
lems. 


1. (Existence) Given an initial value problem, is there always a solution? 
This is the question of existence. Note that there may be a solution even 
if we cannot find a formula for it. 


2. (Uniqueness) If there is a solution, is it the only solution? This is the 
question of uniqueness. 


3. (Interval of existence) If there is a solution, for which times t does the 
solution to the initial value problem exist? 


Resolution of these theoretical issues is an interesting and worthwhile 
endeavor, and it is the subject of advanced courses and books on differential 
equations. In this text we briefly discuss the matters. The next three examples 
illustrate why these are reasonable questions. 


Example 1.36 


The initial value problem 
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has no solution because the derivative of x is not defined in an interval contain- 
ing the initial time ¢ = 1. There cannot be a solution curve passing through 
the point (1, 2). 


Example 1.37 


Consider the initial value problem 


Both x(t) = 0 and a(t) = # are solutions to this problem on the interval 
—co < t < oo. Thus it does not have a unique solution. 


The following theorem, proved in advanced books, provides partial answers 
to the questions raised above. The theorem basically states that if the right 
side f(t,2) of the differential equation is nice enough in a domain in the ta 
plane containing the point (to, zo), then there is a unique solution that passes 
through the that point. A. Cauchy, in the 1820s, was the first to prove such an 
existence theorem. 


Theorem 1.38 


Assume the function f(¢t,x) and its partial derivative’ f,(t,x) are continuous 
in a rectangle a <t<b,c<a<d. Then, for any value tp) na<t< band 2 
inc <a <d, the initial value problem 


z= f(t, x), 
{ KO = me, (1.28) 


has a unique solution valid on some open interval a <a <t< 2 < b containing 
to. 


The theorem tells us nothing about how big the interval (a, 3) is. The 
interval of existence is the set of all time values for which the solution to the 
initial value problem exists. That interval may not extend out to the boundaries 
of the rectangle. Theorem 1.38 is called a local existence theorem because it 
guarantees a solution only in a neighborhood of the initial time to. Notice that 
to and xo have to lie in open intervals and not on the boundary of those intervals 
(Figure 1.22). 


3 We use subscripts to denote partial derivatives, and so fr = Of /Ox. 
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Figure 1.22 Solution to an initial value problem. The fundamental questions 
are: (a) Is there a solution curve passing through the given point? (b) Is the 
curve the only one? (c) What is the interval (a, ) on which the solution exists? 


Example 1.39 


For the differential equation 
ge =1+27, 


f(t,v) =1+2?, and f,(t,x) = 2x. Clearly both are continuous in the entire tx 
plane. If we choose any initial condition x(t) = 2 we are guaranteed to find 
an open neighborhood about it where a unique solution exists. Say we choose 
x(0) = 0. Then the unique solution is 7(t) = tanx which exists in the interval 
(—1/2, 7/2). So, no matter how large we choose the rectangle, the solution will 
not extend beyond this interval. Hence, even though f and f, are very nice 
in a large domain, the solution may of the IVP may be valid in only a small 
interval. 


Example 1.40 


In Example 1.37 what went wrong? Here, f(t, 7) = 2,/z, and its partial deriva- 
tive f,(t,2) = 1/./a, are both continuous in the upper half-plane x > 0. 
However, the initial point t = 0, x = 0 lies on the boundary of that region. 
There is no open rectangle containing the initial point where f and f,; are con- 
tinuous. The theorem does not apply. However, if the initial value is entirely in 


the region « > 0 there is a unique solution. 
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Example 1.41 


(Linear equations) First-order linear equations have very nice properties. 
Consider the IVP 


(IVP) { oe a(t); (1.29) 


If p and q are continuous on any open interval J containing to, then there is 
a unique solution to the IVP on the entire interval J. The proof of this result 
follows from the fact that linear equations have analytic solutions containing 
the integrals of continuous functions, which are in fact differentiable. Take the 
initial value problem 

ta’ +2¢=4t?, 2x(1)=2. 


In normal form 9 
a’ + 7 = 4t. 


Here, p(t) = 2/t and q(t) = 4t. The function p(t) is continuous on t < 0 and 
t > 0, but not at t = 0; and q(t) is continuous for all t. The initial time t = 1 
lies in the interval t > 0. So there is a unique solution on 0 < t < +o. In fact, 
the solution is 


1 
a(t) =t + 5, t>0. 


For linear equations we can usually find the interval of existence by simple 


inspection. 


EXERCISES 


1. State explicitly how you know that the IVP 
g=(P?+1)2-t, 2x(1)=3 
has a unique solution valid in some interval containing t = 1. 
2. Can you guarantee that the IVP 


potas) 1 


C= tga sk SO 


has a unique solution valid in some interval containing t = 0? 


3. For which initial points (to, 29) are you assured that the initial value prob- 
lem 


has a unique solution? 


1.5 
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. Find the largest interval where the solution to the IVP exists: 


1 1 
t— 4 =e? 2)=1. b 4 = — 4) =1. 
a) t(#(—5)a°+a=e", x(2) ) @ +e ,-7? x(4) 


. Find the regions in the at plane where the hypotheses of Theorem 1.38 


hold: 


2+? 
a) =o b) (2t+52x)2’ =t—«2. 
rx 


. In each of the following problems, find how the solution depends on the 


initial condition x(0) = xo: 


a) =, b) af +2°=0. (C2 =a, 


. Verify that the initial value problem x’ = \/z, x(0) = 0, has infinitely many 


solutions of the form 


0 t<a 
t = >) feats 
a(t) { +(t —a)?, t>a, 


where a > 0 is fixed. Sketch these solutions for three different values of a. 
Why might you not be surprised at this result? 


. Verify that the linear initial value problem 


2(4—1 
f= HEY, a) =1, 
t 
has a continuously differentiable solution (i.e., a solution whose first deriva- 


tive is continuous) given by 


(t) = at? +1, t<0, 
OS) p41, t>0, 


for any constants a and b. Yet, there is no solution if x(0) 4 1. Do these 
facts contradict Theorem 1.38? 


2 


Second-Order Linear Equations 


In this chapter we study second-order linear differential equations of the form 
ax” + ba’ + cx = f(t) 


and their applications to classical mechanics and electrical circuits. These appli- 
cations are standard fare and a centerpiece in both elementary physics and 
engineering courses, and they serve as prototypes for oscillating systems, oscil- 
lating systems with dissipation, or damping, and forced vibrations that occur 
in all areas of pure and applied science. In the final sections of the chapter we 
extend the coverage to linear equations with variable coefficients. 


2.1 Classical Mechanics 


Newton’s second law is familiar from high school physics and beginning calculus 
courses. It is the fundamental law of classical particle dynamics and is perhaps 
the most well known law in elementary physics. Its simple statement is: force 
equals mass times acceleration, or F = ma. When an external force acts on 
a particle of mass m, it changes the momentum, or inertia, in the system. If 
x = x(t) denotes the position of the particle, then the particle undergoes an 
acceleration given by the second derivative, x” (t). Thus Newton’s law takes the 
form mx” = F, which is a second-order differential equation for the position 
x. In the general case, the external force could depend on time t, the position 
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equilibrium 
x=0 
' I 
x(1) | 


Figure 2.1 Spring—mass oscillator. x(t) is the displacement of the mass at 
time t, where z = 0 is the equilibrium positon; 2(t) > 0 when the mass is 
displaced to the right. 


x, and the velocity x’. Therefore Newton’s law of motion can be expressed 
generally as 


max" = F(t,a,2’'), (Newton’s Second Law) 


where the form of the force F(t, x, x’) is prescribed. 
In dynamics we expect to impose two initial conditions, 


x(0)=20, 2 (0)=%, 


where po is the initial position and 2, is the initial velocity. In general terms, 
the program of classical mechanics is deterministic; that is, if the initial state 
(position and velocity) of a system is known, as well as the forces acting on 
the system, then the state of the system is determined for all times t > 0. 
Practically, this means we solve the initial value problem above associated 
with Newton’s law to determine the evolution of the system x = z(t). 


2.1.1 Oscillations and Dissipation 


Oscillatory behavior is a common phenomenon in mechanical, biological, elec- 
trical, atomic, and other physical systems. We begin with a prototype of a 
simple oscillatory system, a mass connected to a spring. 


Example 2.1 


(Oscillator) Imagine a mass m lying on a table and connected to a spring, 
which is in turn attached to a rigid wall (Figure 2.1). At time t = 0 we displace 
the mass a positive distance xp to the right of equilibrium and then release it. If 
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we ignore friction on the table then the mass executes simple harmonic motion; 
that is, it slides back and forth at a fixed frequency and amplitude. Following 
the doctrine of mechanics we write Newton’s second law of motion, mx” = F%, 
where the state function z = x(t) is the position of the mass at time t; we take 
x = 0 to be the equilibrium position and x > 0 to the right; the spring exerts 
external force F’,, which must be prescribed. Experiments confirm that if the 
displacement is not too large (which we assume), then the force exerted by the 
spring on the mass is proportional to its displacement from equilibrium, or 


PF, = —ka. (Hooke’s Law) (2.1) 


The minus sign appears because the force opposes positive motion, which is 
to the right. The force is negative when x > 0, and positive if « < 0. The 
proportionality constant k > 0 (having dimensions of force per unit distance) 
is called the spring constant, or stiffness of the spring, and Equation (2.1) 
is called Hooke’s law. Not every spring behaves in this manner, but Hooke’s 
law is used as a model for some springs. In engineering such a law is called a 
constitutive relation; it is an empirical result rather than a law of nature. 
This is an example of a linear force that depends only on the position z. 

To give more justification for Hooke’s law, suppose the force Ff, depends on 
the displacement x through F = F;(x), with F,(0) = 0. By Taylor’s theorem, 


1 
F(z) = F,(0)+ Fi(0)e+ 5 Fs (0)2” foe: 
1 
= —-kr+ 5 Fs (O)a? fees, 
where we defined F’(0) = —k. So Hooke’s law is a good approximation if 


the displacement is small, allowing the higher-order terms in the series to be 
neglected. 

We can measure the stiffness k of a spring by attaching it to the ceiling 
without the mass. Then we attach the mass m and measure the elongation D 
after it comes to rest. The force of gravity mg (downward) must balance the 
restoring force kx (upward) of the spring, so mg = kL. Therefore, 

mg 
k=—. 
L 
Newton’s law, or the equation of motion of the system, is therefore 
ma" = —ka. (2.2) 


This is the spring-mass equation. The initial conditions are x(0) = xo, the 
position where the mass is released, and the velocity x’(0) = x1 given to it at 
time t = 0. 
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As a special case, suppose the initial velocity is zero. That is, we just displace 
the mass to 2p and release it. The initial conditions are 


s0\=%p,. # (0) =0. 


We expect oscillatory motion. Assuming a solution of (2.2) of the form a(t) = 
Acoswt for some unknown frequency w and amplitude A, we find upon sub- 
stitution into (2.2) that w = \/k/m and A = ao. (Verify this!) Therefore, the 
position of the mass at time t is given by 


u(t) = x9 cos V/k/mt. 


This solution is an oscillation of amplitude 29, natural frequency ,/k/m , and 
period 27 divided by the frequency, or 27,/m/k. 


Now we add an additional force, that of the frictional force of the table 
exerted on the mass. Friction is a force that opposes positive motion and it 
dissipates, or decreases, the energy in the system. Dissipation in mechanical 
systems include friction, air resistance, and so on, which are also called damping 
forces. In circuits, electrical resistance dissipates the energy in the circuit. These 
energies often are transformed to heat energy. 


Example 2.2 


(Damped Oscillator) Assume there is friction as the mass slides on the table. 
The simplest constitutive relation is to take the frictional force to be propor- 
tional to how fast the mass is moving, or its velocity x’. Thus 


Fa =—y2', (damping force) 


where 7 > 0 is the damping coefficient (mass per time). If the mass is moving 
to the right, or 2’ > 0, the damping retards the motion and Fy < 0. Therefore, 
the total external force is the sum 


F=F,+ Fy =—kxr—- ya’. 
The equation of motion is 
ma" = —ya! — ke. (damped oscillator) 


This equation is called the damped oscillator equation. Both forces have 
negative signs because each opposes positive (to the right) motion. For this 
case we expect an oscillatory solution with a decreasing amplitude during each 
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oscillation because of the presence of friction. One such a solution, a damped 
oscillation, takes the form of 


a(t) = Ae cos wt, 


where A is some amplitude, \ is a decay rate, and w is the frequency. 


The Mechanical-Electrical Analogy 


There is great similarity between the damped spring-mass system and an 
RCL circuit. We can write the damped oscillator equation with unknown dis- 
placement x(t) as 


ma" + ya! + kr = 0. (damped oscillator) 


Interestingly enough, from Section 1.5, the current I(t) in an RCL circuit with 
no electromotive force (emf) satisfies 


1 
LI" + RI’ + a =10; (RCL circuit) 


which has exactly the same form. This similarity is a classical example of the 
unifying nature of mathematics in science. The similarity between these two 
models is called the mechanical—electrical analogy: 


e The spring constant k is analogous to the inverse capacitance 1/C; both a 
spring and a capacitor store energy in the system. 


e The damping constant 7 is analogous to the resistance R; both friction in a 
mechanical system and a resistance in an electrical system dissipate energy, 
often in the form of heat. 


e The mass m is analogous to the inductance L; both represent inertia in the 
system; a large mass or inductance causes the velocity or current, respec- 
tively, to resist change. In the case of a circuit, an inductor (or coil) stores 
energy in its magnetic field which resists changes in current. 


In every equation we encounter, we want to understand the meaning of each 
term. In the analogy above the first term is the inertia term, the second term 
is the dissipation or energy loss term, and the third is an energy storage term. 
Many of the equations we examine in this chapter can be regarded as either 
circuit equations or mechanical equations. Common among them are the phys- 
ical properties of inertia, damping, and oscillation. In Section 2.3 we consider 
additional forces on the system due to external forcing or an electromotive 
force. 
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Energy Considerations 


To get a better idea about the role of dissipation in a system, let us think 
a little deeper about energy. For a damped spring-mass system, the governing 
equation is 
max" +a’ +kx =0. 
To get energy expressions, multiply this equation by the velocity x’ to obtain 


ma'c" + ya'c' + kara’ = 0. 


Each term has units of energy per time. By the chain rule 


d d 
He (t)? = 22'(t)a"(t) and Getty” = Dae) (t). 
Therefore, the energy equation can be written 
d |1 1\2 I 2 Pal 
—/= =k =— F 2: 
7 5x’) + 5 ha yx x (2.3) 


The two terms inside the left bracket are the kinetic energy and potential energy 
in the system: 
1 1\2 : : 1 2 . 
7 gmx )* (kinetic energy); V = ght (potential energy) 


To understand potential energy, recall that the force is the negative derivative 
of the potential. The force is F(a) = —ka, so the potential energy due to that 
force is the negative integral of the force, or 


vie [Ceajae Z ska. 


Therefore (2.3) is an energy dissipation law 
dE d 
dt = dt 

stating that the total energy E = T+ V in the system is dissipated at the rate 

—ya'v'. Energy per time is power, so (2.3) is the power lost in the system. 

If there is no damping in the system then 7 = 0 and we have 


1 1 
5m(a')” + sha =F, E constant. 


This is the conservation of energy law. 


EXERCISES 


1. When a mass of 0.3 kg is placed on a spring hanging at rest from the ceiling, 
it elongates the spring 5 cm. What is the stiffness k of the spring? 


[T+V] =—-y2'2’, 
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2. (a) Beginning with the RCL circuit equation expressed in terms of charge 
Q on the capacitor, or 


1 
LQ” + RQ! + Ge =0, 


derive the energy dissipation law corresponding to a spring-mass oscillator 
(2.3). (b) Identify the energy in the inductor and on the capacitor. (c) Show 
that the power lost by the resistor is —RI?. (d) If there is no resistor, what 
is the conservation of energy law for the circuit? 


3. We derived the spring-mass equation for a mass moving horizontally on 
a table top. This exercise shows that the same equation holds for a mass 
oscillating on a vertical, perfectly elastic string (or a spring) under the 
influence of the force of gravity mg. We assume Hooke’s law holds for the 
string, that is, the force exerted by the string is proportional to its dis- 
placement. See the set up in Figure 2.2, where we introduce two coordinate 
systems, x and y, to measure displacement. First, only the string of natural 
length LD is attached with no mass. This is position y = 0. Then we attach 
the mass, and at equilibrium it reaches a natural length L + AL; this is 
position x = 0. Next we pull the mass down a positive distance and release 
it, and it undergoes oscillatory motion. 


a) Use Newton’s second law and Hooke’s law to justify the equation of 


motion 
A 


my = —ky+mg. 
b) In the x coordinate system show that the equation of motion is 
ma” = —ka, 


where the gravitational force does not appear. Hint: Note that y = 
x+AL and use the definition of the stiffness, kAL = mg. 


c) Show that if damping occurs, then the governing equation is ma” = 
—kx — ya. 


2.2 Equations with Constant Coefficients 


Both the damped spring-mass equation and the RCL circuit equation have the 
form, namely, 
ax” + ba’ + cx = 0, (2.4) 
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Figure 2.2 Two coordinate systems x and y for the motion of a mass m 
attached to a perfectly elastic string, or a spring, subject to both a gravitational 
force mg downward and a restoring force given by Hooke’s law. 


where a, b, and c are constants. An equation of the form (2.4) is called a homo- 
geneous linear equation with constant coefficients. The word homoge- 
neous refers to the fact that the right side is zero, meaning there is no external 
forces acting on the mass or no emf in the circuit. (In Section 2.3 we include 
these types of forces.) Equation (2.4) can be accompanied by initial conditions 
of the form 

x(0)=20, «x'(0) = 24. (2.5) 


Here, we are using « = x(t) as the generic state function. 

The problem of solving (2.4) subject to (2.5) is called the initial value 
problem (IVP). In (2.5) the initial conditions are given at t = 0, which is 
the common case, but they could be given at any time t = to. Finally, in the 
spring-mass problem and RCL circuit problem the constants a, b, and c are 
nonnegative, but our analysis is valid for any values of the constants. 


2.2.1 The General Solution 


We develop a simple technique to solve the homogeneous linear equation 
ax” + ba’ + cx = 0. 


Fundamental to the discussion is the following existence—uniqueness theorem, 
which is proved in advanced texts; it also includes a definitive statement about 
the interval where solutions are valid. 


Theorem 2.3 


(Existence-Uniqueness) The initial value problem (2.4)—(2.5) has a unique 
solution that exists on —oo < t < oo. 
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The issue is how to find the solution. For the constant coefficient equa- 
tion (2.4), with no initial conditions, we demonstrate that there are always 
exactly two independent solutions, say x;(t) and x2(t), meaning one is not 
a constant multiple of the other; they are not proportional. Such a set of solu- 
tions, 21 (t), v2(t), is called a basic, or fundamental set. Further, if we multiply 
each by an arbitrary constant and form the linear combination 


x(t) = c1a1(t) + coxa(t), (2.6) 


where c; and cg are arbitrary constants, then we can easily check that x(t) 
is also a solution to the differential equation (2.4). (This is the superposition 
principle—see Exercise 3.) The linear combination (2.6) is called the general 
solution to (2.4), which means that all solutions to (2.4) are contained in this 
linear combination for different choices of the constants c; and c2. In solving the 
initial value problem we use the initial conditions (2.5) to uniquely determine 
the constants c; and c in (2.6). 


Theorem 2.4 


(General Solution) Let x1(t), v(t) be a fundamental set of solutions of 
(2.4), and let ¢(t) be any other solution. Then there exists unique values of the 
constants c; and cy such that 


P(t) = cra1(t) + cora(t). 


To prove this result, let 21(t) and x2(t) be the unique solutions that satisfy 
the initial conditions 


(0) = 1, 2, (0) =O, 2(0) =0, 2,00) = 1, 


respectively, and let ¢(t) be any solution of (2.4). ¢(t) will satisfy some condi- 
tions at t = 0, say, ¢(0) = A and ¢’(0) = B. But the function 


a(t) = Ax; (t) + Bao(t) 


satisfies those same initial conditions, 7(0) = A and 2’(0) = B. By the unique- 
ness theorem, Theorem 2.3, ¢(t) = x(t) and so cy = A, co = B. So the solution 
g(t) is contained in the general solution. 


Construction of Solutions 


Our strategy now is to find two independent solutions x(t) and x(t) of 
(2.4). We suspect something of the form 


aioe”, 
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where X is a constant to be determined, might work because every term in 
(2.4) has to be the same type of function for cancelation to occur; thus, z, x’, 
and x” must be the same form, which suggests an exponential function for «. 
Substitution of x = e*! into (2.4) instantly leads to 


ad” +bA+c=0, (characteristic equation) (2.7) 


which is a quadratic equation for the unknown A. Equation (2.7) is called the 
characteristic equation. Using the quadratic formula, we obtain its roots 


1 
A= 5a (-» + Vb? — 4ac) ; (eigenvalues) 
a 
These roots of the characteristic equation are called the eigenvalues corre- 


sponding to the differential equation (2.4). Each value of A gives a solution 
x(t) = e** to the equation 


ax” + bx’ + cx = 0. 


Clearly, the values of X could be real numbers or complex numbers. Thus, 
there are three cases, depending upon whether the discriminant b? — 4ac is 
positive, zero, or negative. 


Case 1. If b? — 4ac > 0, then there are two real unequal eigenvalues \, and 
A2. Hence, there are two independent, exponential-type solutions 


x1(t) = ert x(t) = eet M1 x r2. 


Therefore the general solution to (2.4) is 


PER oe pene, (2.8) 


x(t) = ce 

Case 2. If b? — 4ac = 0 then there is a double root Ay = —b/2a, Az = —b/2a. 

Then one solution is 21(t) = e**, where \ = —b/2a. A second independent 

solution in this case is x(t) = te**. (Later we show why this solution 
occurs.) Therefore the general solution to (2.4) in this case is 


a(t) = cye™* + egte™. (2.9) 


Case 3. If b? — 4ac < 0 then the roots, or eigenvalues, of the characteristic 
equation are complex conjugates having the form* 


Ay =a+iB, Ag =a— iB, 


* Notation: Any complex number z can be written z = u+ iv, where u and v are 
real numbers; wu is called the real part of z and v is called the imaginary part of 
z. Similarly, if z(t) = u(t) + iv(t) is a complex function, then u(t) and v(t) are its 
real and imaginary parts, respectively. The numbers u + iv and u — iv are called 
complex conjugates. 
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where , ‘ 
a=-—, B=—vV4ac— BP. 

2a 2a 
Therefore two complex-valued solutions of (2.4) are 


x1(t) = glarie ye r2(t) = elo iB) 


But we want real-valued solutions. This case requires a more detailed dis- 
cussion, provided in Section 2.2.3. 


2.2.2 Real Eigenvalues 


We first present examples where the characteristic equation has real eigenval- 
ues. 


Example 2.5 
(Real, unequal eigenvalues) The differential equation 
xv’ —a' — 127 =0 
has characteristic equation 
-—A-12=0 or (A+3)(A—4) =0. 


The eigenvalues are 
A = —3, 4. 


These are real and distinct and so a fundamental set of solutions is 21 (t) = e~**, 
x2(t) = e*. The general solution to the equation is 


a(t) = cje—** + ce". 


Example 2.6 


(Real, equal eigenvalues) The differential equation 
x” + 4a" +42 =0 
has characteristic equation 
M+4+444+4=0 or (A+2)(A+2)=0. 


The eigenvalues are 
A = —2,-2, 


90 2. Second-Order Linear Equations 


which are real and equal (a double root). The fundamental set of solutions is 
x(t) =e 7", x(t) = te’. The general solution is 


2t 


a(t) = ce ** + cate 


Example 2.7 


If the eigenvalues are X = 6 and A = —2, find the differential equation. The 
characteristic equation must factor into (A — 6)(A + 2) = 0. Multiplying out, 
the characteristic equation is then \? — 4\ — 12 = 0. The differential equation 
must be x” — 4x’ — 127 = 0. 


EXERCISES 


1. Find the general solution: 


(a) a” — 4a’ + 4a = 0. (c) $a" +a'+42=0. 
(b) 2” — 22’ =0. (d) #” +42’ + 3x4 = 0. 


2. In Exercise 1, parts (a) through (d), find the solution satisfying the initial 
conditions x(0) = 1, 2’(0) = 0. 

3. In Exercise 1, part (d), find the solution satisfying the initial conditions 
x(0) = —1,2/(0) =2. 

4. Which of the equations in Exercise 1 can have a physical meaning in the 
context of a spring-mass or damped spring-mass oscillator? 

5. Suppose x,(t) and w(t) are two solutions to ax” + bx’ +cxr = 0. Show that 
x(t) = c121(t) + cgx1(t) is also a solution. 

6. Find an equation that has general solution x(t) = cie* + cpe~™. 


7. Find an equation that has solution z(t) = e~** + 2te~°*. What are the 
initial conditions? 


8. Show that the graph of any solution of the equation x” + 2az’ + a?x = 0, 
a > 0, with two negative equal eigenvalues cannot cross the t axis more than 
once. Hint: Find the general solution and assume, by way of contradiction, 
that there are two crossings. 
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2.2.3 Complex Eigenvalues 


We return to Case 3, the case of complex eigenvalues, or roots, of the charac- 
teristic equation. The following important theorem indicates that a complex- 
valued solution always defines a set of two real-valued solutions, or a funda- 
mental set. 


Theorem 2.8 


If a(t) = g(t) + th(t) is a complex-valued solution of the differential equa- 
tion (2.4), 
ax” + ba’ + cx = 0, 


then its real and imaginary parts, x1(t) = g(t) and x2(t) = A(t), are real-valued 
solutions. 


To see why this is true, substitute the solution x = g(t) + th(t) into the 
differential equation ax” + bx’ + cx = 0 to get 


a(g(t) + ih(t))" + b(g(t) + th(t))’ + e(g(t) + ih(t)) = 0, 
and then rearrange to get 
[ag" (t) + bg’ (t) + cg(t)] + i[ah’ (t) + bh’ (t) + ch(t)] = 0. 


The left side is complex-valued and equal to zero. The only way complex num- 


5 


bers can equal zero is if both the real and imaginary parts are zero,” or 


ag” (t) + bg’ (t) + eg(t) =0, ah’ (t) + bh'(t) + ch(t) = 0. 


But this means, g = g(t) and h = h(t) are real-valued solutions to (2.4). 


Let us take the first of the complex solutions, e(¢+#9)*, given in Case 3 and 
expand it into its real and imaginary parts using Euler’s formula: 


et — cos Bt + isin Bt. (Euler’s formula) 
We have 


elotiB)t — erteiBt — 6% (cos Bt + isin Bt) 


= e™ cos Bt + ie® sin ft. 


° If a+ bi = 0, where a and b are real, then, necessarily, a = b = 0. 
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Therefore, by Theorem 2.8, 
ri(t)=e™ cosBt and x(t) = e™ sin Gt 


are two real independent solutions to Equation (2.4). If we take the second of 
the complex solutions, e‘°~*%)', with the minus sign, then we get the same two 
independent, real solutions. Consequently, we can refine Case 3 and state: 


Case 3. If the eigenvalues of the characteristic polynomial are complex, \ = 
a+i6, then the general solution to (2.4) is 


x(t) = cye“ cos Bt + coe sin Bt. (2.10) 


If a < 0, these solutions represent decaying oscillations and if a > 0, these 
solutions represent growing oscillations. 


Example 2.9 


(Complex eigenvalues) The differential equation 
x” +20’ +52 =0 
has characteristic equation 
+4245 =0. 
The quadratic formula gives complex roots 


A= -142i. 


Therefore the general solution is 


x(t) = cye' cos 2t + ce * sin 2t. 


Purely imaginary eigenvalues 


Purely imaginary eigenvalues, \ = +723, are a special case of complex eigen- 
values in Case 3. From the general solution (2.10) we set a = 0 and get the 
general solution 

x(t) = c, cos Gt + cg sin Bt. 


These solutions are purely oscillatory with frequency 6 and period 27/8. 
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Example 2.10 


Consider the initial value problem 


xv’ +7x =0, 
z0j=1, 2 (0)=2. 


The characteristic polynomial is \? + 7 = 0, or A? = —7. Taking the square 
root we get two purely imaginary eigenvalues, 


A=4v7i. 


Therefore the general solution to the differential equation is 


x(t) = c1 cos V7t+cosinv7t. 
Applying the initial conditions gives (noting sin0 = 0, cos0 = 1) 
x(0) el Od L. 


Then, 
a’ (t) = —V7e sin V7t + V7 cg cos V7 t. 


Hence, 
a'(0)=V7e2=2, or c= 


Ss 


Therefore the solution to the initial value problem is 


2 
x(t) = cos/7t + —=sinv7t. 
(t) 7 


Notice that the solution is purely oscillatory, or periodic of period 27/ V7 and 
frequency V7. 


For easy reference, in the following table we summarize the form of solutions 
(Table 2.1). 
Hyperbolic form. The equation 


cz’ —a?x =0 


occurs often and has real eigenvalues \ = +a; the general solution is 
x(t) = ce + coe, 


which is exponential. This equation can also be written in terms of the hyper- 
bolic functions cosh and sinh as 


x(t) = c, coshat + ce sinhat, 
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Table 2.1 Table showing the general solution of the equation aa” + ba’ + 
cx = 0. The eigenvalues \ are the two roots of the characteristic equation 
ad? +bA+c=0. 


At # 2 (real, unequal) x(t) = e*1* + cyer2! 


t 
Ay = Ag (real, equal) a(t) = cye*! + cote™! 


\ = a+ fi (complex) x(t) = cje™ cos Bt + coe™ sin Bt 


\ = +1, (purely imaginary) x(t) = c1 cos Gt + cg sin Bt 


where at 7 - . 
7 eT et — e7 
cosh at = aes sinh at = ——————_- 
2 2 
It is sometimes it is easier to apply initial conditions with the hyperbolic form 


of the general solution. 


EXERCISES 


1. Find the general solution: 


(a) o” +a'+4r =0. (d) «” — 127 =0. 
(b) 2” — 4a’ + 62 = 0. (e) 2a” + 3a’ + 34 =0. 
(c) x” + 9x =0. (f) $2” + 2a’ + 22 =0. 


2. In Exercise 1, parts (a) through (f), find the solution satisfying the initial 
conditions x(0) = 1, 2’(0) = 0. 
3. Find an equation that has solution x(t) = sin4t + 3cos4t. What are the 


initial conditions? 


4. Find an equation having general solution x(t) = c, cosh 5t + cy sinh 5t, 
where c, and cz are arbitrary constants. Find the arbitrary constants when 
x(0) = 2 and 2’(0) = 0. 

5. Find an equation with solution x(t) = e~"(sin 4t + 3.cos4t). What are the 
initial conditions? 


6. Use Euler’s formula to show 1+ e'” = 0. Why do you think this formula is 
interesting? 


7. Find a differential equation that has independent solutions x; = e~*/? cos 3t 
and 2 = e~*/? sin 3t. 
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2.2.4 Applications 


This section focuses on applications to damped spring-mass systems and RCL 
circuits. We work in the context of mechanical systems, but because of the 
mechanical-electrical analogy, all of the concepts apply to circuits as well. 
There is suggestive terminology used in engineering and physics to describe 
the motion of a spring—mass system with damping, governed by the equation 


ma” + ya" + ka = 0. 
The characteristic equation is 
mM’ +7A+k =0, 


with roots, or eigenvalues, 


,- DF Jy? — 4mk 


2m 


The first observation is that the physical coefficients m, y, and k are all nonneg- 
ative. This restriction on the coefficients places restrictions on the eigenvalues 
and their signs. 


(1) If 72 —4mk > 0, the eigenvalues are real and distinct and they are both 
negative. The resulting solution decays to zero and the damped spring-mass 
system is called overdamped. In an overdamped system, the damping 
constant dominates the stiffness of the spring and the size of the mass. 


(2) If y? = 4mk the eigenvalues are real and equal. They are negative and the 
solution decays to zero. In this special case the system is called critically 
damped. Damping balances mass and the stiffness of the spring. 


(3) If y2 — 4mk < 0 the eigenvalues are complex. The eigenvalues have neg- 
ative real part —y/2m, and the solution is a decaying oscillation, or 
underdamped. The mass and the spring stiffness dominate damping. If 
7 = 0, there is no dissipation in the system and the eigenvalues are purely 
imaginary, giving an oscillatory solution. See Figure 2.3. 


Here we often use the terminology “decaying oscillation” rather than “under- 
damped,” and “damped” for both the overdamped and critically damped cases. 


Example 2.11 


(a) In the differential equation 


Qe" +a' +32 =0 
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0 5 10 0 5 10 


Figure 2.3. On the left, a decaying oscillation « = 2e~*/? cos(5t); the expo- 


nential factor 2e~'/? forms an envelop (dashed) of the oscillatory term. On the 
right, a pure oscillation x = cos(5t). 


we have y? — 4mk = 1 — 4(2)(3) = —23 < 0, so the solution is a decaying 
oscillation. The eigenvalues are complex, or 
1 (v/23 


ae Gal A ; 


and the general solution is 


/23 4/4. V23 


x(t) = cie*/* cos tt eve sin a 
(b) The differential equation 
3a" +52 =0 


has no damping term (y = 0) so the solution is purely oscillatory. The eigen- 
values are 


and the general solution is 


(t) = cos [t+ sin yf 
x = Cl 3 C1 = 


Phase-Amplitude form 


In the case of purely imaginary eigenvalues, we show from elementary 
trigonometry that the general solution 


x(t) = c1 cos Bt + cg sin Bt 
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can be written simply as 
x(t) = Acos(St — 9), 


where A is the amplitude and y is the phase. This form is called the phase— 
amplitude form of the general solution. Written in this form, A and y play 
the role of the two arbitrary constants, instead of c; and cg. We now show that 
that all these constants are related by the formulas 


C2 
A= ,/24+c, y=arctan—. 
C1 


This is because the cosine of difference expands to 
Acos(Gt — y) = Acos(8t) cosy + Asin((t) sin y. 
Comparing this expression to c; cos Gt + cz sin Bt, gives 
Acosy=ci, Asinyg=cy. 


Squaring and adding this last set of equations determines A, and dividing the 
set of equations determines y, both given as above. Note that the equation 
above for y is valid in the first and fourth quadrants and occurs when c, > 0. 
If c, < 0, in the second and third quadrants, then we add 7, that is y = 
arctan C2/c1 + 7. 

Sums of sines and cosines are difficult to plot without a calculator. But, we 
can write the phase-amplitude form as 


x(t) = Acos(6t — y) = Acos E (« - *)| , 
which easily plots as a shifted cosine function of frequency 8 and amplitude 
A. The amount of the shift, y/G, is called the phase shift. The period of 
oscillation is 27/3 (in units of time). The frequency {3 is also called the natural 
frequency of the oscillator. 


Example 2.12 


For a spring-mass system with mass m = 1 kg and spring with stiffness k = 
5 N/m, the initial position is 2 m and initial velocity is 1 m/s. The initial value 
problem is 

a epee 0. ai 0) Doce (0) 


The eigenvalues are \ = +/5 i, so a fundamental set of solutions is cos V5t, 
sin /5t. The solution to the initial value problem is easily found to be 


1 
x(t) = 2cosV5t + — sin Vt. 
) V5 
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So, cy = 2 and cg = 1/V5. To determine the phase-amplitude form of the 
solution, we note 


| 1 /21 1 
A=,/44+2=4/— = arct — = } © 0.22 
TE 5 y = arc an (5) A 


because y is in the first quadrant. Thus, the phase-amplitude form of the 
solution is 


x(t) = [2 cosv5¢ — 0.22) = [2 cos (v5 - 0.098) 


The phase shift is 0.22//5 = 0.098. The solution plots as the curve cos(V/5t) 
shifted to the right by 0.098 and stretched vertically by the amplitude ,/21/5 = 
2.049. 


Example 2.13 


The differential equation 


ve” +2e’+5¢ =0 
HO) =e (0) 3, 


models a damped spring—mass system with m = 1, y = 2, and k = 5. Initially 
it is displaced 1 unit and then given an initial velocity of 3 units. The charac- 
teristic equation is A? +2\+5 = 0. The quadratic formula gives complex roots 
A = —1+ 2i. Therefore the general solution is 


x(t) = ce ‘cos 2t+ ce‘ sin 2t, 


representing a decaying oscillation. We can use the phase-amplitude form to 
rewrite the oscillator part and obtain 


x(t) = Ae~* cos(2t — y). 


The initial conditions are 7(0) = 1, x'(0) = 3. We can use these conditions 
directly to determine either c; and c2 in the first form of the solution, or A 
and y in the phase-amplitude form. Going the former route, we apply the first 
condition to get 
x(0)=cq =1. 
To apply the other initial condition we need the derivative. We get 
a’ (t) = —2cye" sin(2t) — c1e~‘ cos(2t) + 2cge~‘ cos(2t) — cpe~* sin(2t). 


Then 
x'(0) = —c, + 2c2 = 3. 
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Therefore cz = 2. The amplitude of the oscillatory part is 


A=V11422=V5, 


and the phase is 


vy = arctan 2 = 1.107 radians. 


In phase—amplitude form the solution is 


a(t) = V5e~* cos(2t — 1.107). 


The oscillatory part has natural frequency 2 and the period is 7. The phase 
has the effect of translating the cos2t term by 1.107/2 = 0.554, which is the 


phase shift. 


EXERCISES 


1. 


Find the solution to the initial value problem x” +2'+2=0, 2(0) = 
x'(0) = 1, and write it in phase-amplitude form. 


. A damped spring—mass system is modeled by the initial value problem 


xv” +0.1252’+2=0, 2(0)=2, 2'(0) =0. 


(a) Find the solution and sketch its graph over the time interval 0 < t < 50. 
(b) If the solution is written in the form «(t) = Ae~‘/"® cos(wt — ), find 
A, w, and y. 


. For which values of the parameters k (if any) will the solutions to 2” + a/ + 


kx = 0 oscillate with no decay (i.e., be periodic)? Oscillate with decay? 
Decay without oscillations? 


. An RCL circuit has equation LI’ + I’ + I = 0. Characterize the types 


of current responses that are possible, depending upon the value of the 
inductance L. 


. An oscillator with damping is governed by the equation x2” + 362'+Ka = 0, 
£18 gi 


where 6 and « are positive parameters. Plot the set of points in the d« plane 
where the system is critically damped. 


. Describe the current response I(t) of a LC circuit with L = 5 henrys, C' = 2 


farads, with (0) = 1, J’(0) = 1. Express your answer in phase-amplitude 
form. 
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2.3 Nonhomogeneous Equations 


In the last section we solved the homogeneous equation 
ax” + ba’ + cx =0. (2.11) 
Now we consider the nonhomogeneous equation 
ax” + ba' + cx = f(t), (2.12) 


where a prescribed term f(t), called a source term or forcing term, is 
included on the right side. In mechanics f(t) represents an applied, time- 
dependent force such as an imposed magnetic field driving the mass, and x(t) 
represents the output, or displacement, resulting from that force. 

Engineers and scientists regard equation (2.12) as an input-output system. 
In an RCL circuit the system is defined by parameters L, R, and C; to each 
applied voltage E(t), or emf, which is the input, the response of the circuit is 
the solution Q(t) of the nonhomogeneous equation 


LQ" + RQ’ + aa = Bt). 


Q(t) is the input response. Input-output systems are diagrammed as in Fig- 


ure 2.4. 
10—| sen —+x()_ E(t) — Olt) 


Figure 2.4 The differential equation (2.12) as an input-output system (left). 
An RCL circuit with an emf E(t) as an input and the charge Q(t) on the 
capacitor as the output (right). 


There is a general structure theorem, analogous to the case with first-order 
linear equations, that specifies the form of the solution to the nonhomogeneous 
equation (2.12), and it gives a prescription on how to solve such equations. 


Theorem 2.14 


(General Solution) The general solution of the nonhomogeneous equa- 
tion (2.12) is given by the sum of the general solution to the homogeneous 
equation (2.11) and any specific solution to the nonhomogeneous equation. 
That is, the general solution to (2.12) is 


x(t) = cyx1(t) + cox1(t) + x(t), (2.13) 
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where x(t) and x(t) are two independent solutions to (2.11) and z,(t) is any 
solution whatsoever to (2.12). 


This result is very easy to show using Theorem 2.4. If x(t) is any solution 
whatsoever of (2.12), and z,(t) is a particular solution, then it is easily checked 
that x(t) — x,(t) must satisfy the homogeneous equation (2.11). Therefore, by 
Theorem 2.4, x(t) — v(t) = c121(t) + ce%1(t), which is (2.13). 


Notation. It is useful to introduce the notation x,(t) for general the solution 
to the homogeneous equation (2.11), that is, 


xn(t) = e121 (E) + c2X1(E). 


We call this the homogeneous solution; in some texts, it is called the compli- 
mentary solution. The specific solution z,(t) to the nonhomogeneous equation 
is called a particular solution. The general solution to (2.12) can therefore 
be written 

a(t) = en(t) + p(t), 


which is the sum of the homogeneous solution and the particular solution. 


2.3.1 Undetermined Coefficients 


We already know how to find the solution to the homogeneous equation (2.11), 
so we need techniques to find a specific solution x,(t) to the nonhomogeneous 
equation (2.12): 

ax” + ba’ + cx = f(t). 


One method that works for many equations is simply to make an assump- 
tion, or judicious guess, based on the form of the source term f(t). Officially, 
this method is called the method of undetermined coefficients because we 
eventually have to find numerical coefficients in our choice for z,(t) when we 
substitute it into the differential equation. The method works most of the time, 
because all the terms on the left side of (2.12) must eventually add up to give 
f(t). Therefore the particular solution must have roughly the same form as 
f(t). The method is successful for forcing terms that occur in many mechan- 
ical and circuit problems, such as constants, exponential functions, sines and 
cosines, polynomials, and sums and products of these common functions. 

Table 2.2 indicates the trial form of the particular solution x,(t) depending 
on the form of the source term in the differential equation. 

There is only one sticky issue. If a trial guess x,(t) of the form of a par- 
ticular solution coincides with one of the fundamental solutions 1(t), x2(t) of 
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Form of source function f(t) | Trial form of particular solution x, (t) 


a A 

aeht Ae®t 

Polynomial of degree n Ant” + An_1t?-1 +--+ + Ait + Ag 
asinwt; acoswt Asinwt + Bcoswt 


ae" sinwt; ae" coswt e™'(Asinwt + B coswt) 


Table 2.2 A table showing the form x,(t) of an initial trial particular solution 
to the nonhomogeneous equation ax” + ba’ + cx = f(t) based on the form of 
the source f(t). The Greek letters in the left column denote known constants 
in the source term f(t), while the uppercase Latin letters in the right column 
denote coefficients to be determined in a trial form. 


the homogeneous equation, then that particular solution will itself satisfy the 
homogeneous equation and therefore cannot equal f(t). Then we must modify 
the trial guess. All that is required is to multiply our trial guess by a positive 
power of t. Stated formally, we have: 


Remark 2.15 


Caveat. If a term in the initial trial guess for a particular solution x, duplicates 
one of the fundamental solutions for the homogeneous equation, then modify the 
guess by multiplying by the smallest power of t that eliminates the duplication. 


Several examples illustrate these ideas. As you will soon learn, the analytic 
calculations to determine the unknown constants can often be tedious. But 
the technique is useful to mathematically understand some essential physical 
concepts, such as the origin of resonance. Certainly, solutions to complicated 
problems can be done using one of the many available software packages. 


Example 2.16 


In this first example we ignore the differential equation itself and give some 
simple examples of determining an initial, trial particular solution, based only 
on the form of the forcing function f(t). 


(a) If f(t) = 6, take x,(t) = A. 
(b) If f(t) = 3t? — 3, take z,(t) = At? + Bt+C. 
(c) If f(t) = 12 sin 3t, take x,(t) = Acos3t+ Bsin3t. 
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(d) If f(t) = —3e”*, take z»(t) = Ae*. 

(e) If f(t) = 2te~**, take x,(t) = (At + B)e~*. 

(f) If f(t) = e~* sin 2t, take x,(t) = e~°*(Acos 2t + B sin 2t). 

(g) If f(t) = te~** sin 2t, take xp(t) = (At + B)e~*"(C' cos 2t + Dsin 2t). 


Example 2.17 
Find the general solution to the following equation with a source term 
fijede 

a” 434 = 4e*, (2.14) 


First we find the homogeneous solution x(t). The eigenvalues are \ = +V3i, 
purely imaginary, and the general solution to the homogeneous equation is 


xn(t) = c1 cos V3t+cosin V3t. 


Next we find the particular solution x,(t). The two terms on the left side of 
the (2.14) must add to give f(t), so it is plausible to assume a trial particular 
solution x,(t) = Ae~°’, where A is to be determined. (See the second entry 
of Table 2.2.) Moreover, this form of x, does not coincide with either of the 
two fundamental solutions, cos /3t, sin-/3t. So we substitute «,(t) into the 
differential equation to get 25Ae~*' + 3Ae~*! = 4e—*!, or A = 1/7. A particular 
solution is therefore ; 
L(t) = ze 

Therefore, the general solution to the nonhomogeneous equation (2.14) is x(t) = 
xp(t)+2,(t). By the way, if there are initial conditions, apply them to general 
solution at the end of the calculation and not to only xp. 


Example 2.18 
Solve the differential equation 
ve” — 2 +7x =5t—3. 
The homogeneous solution is 
an(t) = ce~*/? cos(4/27/2t) + cge*/? sin(./27/2t). 


The right side, f(t) = 5t—3, is a polynomial of degree 1 so we try x,» = At+ B, 
a polynomial of degree 1. See the third entry in Table 2.2. Substituting, we get 
—A+7(At+B) = 5t—3. Equating like terms gives -A+7B = —3 and 7A = 5. 
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Therefore, A = 5/7 and B = —16/49, and a particular solution to the given 
equation is 


Example 2.19 


Solve the differential equation 


av" —a2 =5e!. 


The characteristic polynomial for the homogeneous equation is \? — 1 = 0, 
having eigenvalues \ = —1, +1. Therefore a fundamental solution set is e~*, e°, 


and the homogeneous solution is 
es: t 
p(t) =cje "+ ce. 


To find a particular solution, take a trial solution x(t) = Ae~'. But this dupli- 
cates one of the fundamental solutions. If we substitute Ae~* 
we get zero, not 5e~'! So we must modify our trial function by multiplying 
by t, giving z(t) = Ate~*. The duplication is eliminated because this is not 
a solution to the homogeneous equation. So we substitute in the equation to 
obtain 


into the equation 


[Ate~* — 2Ae~*] — Ate~* = 5e~’, 


or —2Ae~' = 5e~*. Thus A = —5/2 and the particular solution is z,(t) = 
—3te~'. The general solution is 


t 


a(t) = ce * + eget — 3te 


First-order equations. The method of undetermined coefficients works equally 
well for first-order equations of the form «’ + px = f(t), where p is constant. 
The homogeneous equation has characteristic polynomial A+ p = 0, giving the 
eigenvalue \ = —p. Its solution is therefore x,(t) = ce~?*. Provided f(t) has 
the form of the entries in Table 2.2, a particular solution z,(t) is found exactly 
as for second-order equations: make a trial guess and substitute into the equa- 
tion to determine the coefficients in the guess. Modify the trial if it duplicates 
the homogeneous solution e~?*. The general solution to the nonhomogeneous 
equation is then x(t) = ce~?! + z»(t). 
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Example 2.20 


Consider the equation 
a’ — 32 = 7. 


The homogeneous solution is 2, = ce*!. The forcing term is a quadratic, so a 
trial guess for a particular solution is a general quadratic, 


tp = At? + Bt+C. 


No term duplicates the homogeneous solution. Substituting this into the equa- 
tion and equating coefficients of like terms gives three algebraic equations for 
A, B, and C, namely 


~3A=1, 2A—-3B=0, B-3C =0. 


Thus A = -, and B= —2, and C = -#. Consequently, the general solution 
is 
1 2 2 
t) = ce®* — 7? — —¢-—- _, 
RS CS Be ay 


This calculation was simple. Using integrating factors would require a more 
complicated integration by parts to obtain the solution. 


Example 2.21 
Find the solution to the initial value problem: 
xv’ +2x=sin3t, 2(0)=1, x'(0)=-1. 


This is a spring-mass oscillator equation with a periodic forcing function having 
frequency 3 and period 27/3. The homogeneous solution, or free response, is 


up(t) = cy cos V2 t+ co sin V2 t. 


It oscillates with natural frequency 8 = 2. To find a particular solution we 
try (Table 2.2) z, = Asin3t+ Bcos3t. Neither of these terms coincide with 
those in the fundamental solution set. Therefore, upon substituting, 


—9Asin 3t — 9B cos 3t + 2Asin 3t + 2B cos 3t = sin 3t. 


Equating like terms gives -9A+2A = 1 and B = 0 (there are no cosine terms 
on the right side). Hence A = —1/7 and a particular solution is 


1 
=—- sin 3t. 
ie 7 sin 
The general solution is therefore 


1 
a(t) = c, cos V2 t+ cgsin V2 t — 7 sin 3t. 
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0) 5 10 1S 20 
Figure 2.5 Plot of z(t) = cos V2 t — a sin V2 t — 4 sin 3t. 


Now we apply the initial conditions. Clearly, z(0) = c; = 1. Then, 
3 
a’ (t) = —V2sin V2 t + coV2 cos V2 t — 7 cos 3t, 


giving 2! (0) = c2V2 — 2 = -1, or cp = —4/7V2. The unique solution to the 


IVP is 
4 


72 


This solution is a superposition of an oscillation of frequency V2 in the homo- 


1 
a(t) = cos V2 t — sin V2 t— 7 sin 3t. 


geneous solution and an oscillation of frequency 3 in the particular solution. A 
plot showing the interaction is shown in Figure 2.5. This models, for example, 
an LC circuit with natural frequency 2 with an emf driving the circuit with 
frequency 3. 


Remark 2.22 


(Superposition) If the source term in a differential equation is a sum f(t) + 
fo(t) of two sources, then we can break up the problem into two separate 
equations if needed, that is, 


ax" +ba' +ca= fi(t) and ax” + ba’! +cxr = fo(t) (2.15) 
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and find a particular solution for each. Then a particular solution of the equa- 
tion 
ax” + ba’ + cx = fi(t) + fa(t) 


is the sum of the particular solutions to (2.15). 


Example 2.23 
Find the general solution to the nonhomogeneous equation 
x” + 3a! + 3a = 6e7** + 4, 


The homogeneous equation has characteristic polynomial \? +3A+3 = 0, which 
has roots \ = —3/2 + iV3/2. Thus the solution to the homogeneous equation 


1S 
V3 


3 
cos ey + ce 3*/2 sin st. 


ap(t) = cye~**/? 
Next we find a particular solution to the nonhomogeneous equation. Take 
fi(t) = 6e~**, and try zp; = Ae~**. Substituting this trial function into the 
nonhomogeneous equation gives, after canceling e~*, the equation 4A — 6.4 + 
3A = 6. Thus A = 1 and a particular solution to the nonhomogeneous equation 
is Zpi =e". Next take f2(t) = 4. A particular solution is quickly a constant, 
Or Lp2 = 4/3. The general solution to the original nonhomogeneous equation is 
V3 4 


J3 3t 
—t+ /2 sj —t+ e =a 
cos 5) C2e sln 5) € + 3 


a(t) = cye3#/? 


Note that limy_,., x(t) = 4. Eventually the transients of the system decay away 
and it settles into a constant steady state. 


Example 2.24 


(RCL circuit) Consider an RCL circuit with R = 2, L = C = 1, with the 
current being driven by an electromotive force of 2 sin 3t. The circuit equation 
for the charge Q(t) across the capacitor is 


Q” + 2Q’ + Q = 2sin3t. 


For initial data take 
Q(0)=4, Q'(0) =0. 


The homogeneous equation has characteristic equation A? + 2\+1=0 witha 
double root A = —1, —1. The homogeneous solution is therefore 


Qn => e (ey + Cot). 
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Regardless of the values of the constants, this decays away as time t increases; 
this part of the solution is called the transient response of the circuit. To 
find a particular solution we use undetermined coefficients and assume it has 
the form 

Q, = Asin 3t + Bcos3t. 


Substituting into the nonhomogeneous equation gives a pair of linear equations 
for A and B, 
-4A—3B=1, 7A-9B=0. 


We find A = —0.158 and B = —0.123. Therefore the general solution is 
Q(t) = e~*(c1 + eat) — 0.158 sin 3t — 0.123 cos 3t. 


Now apply the initial conditions. Easily, Q(0) = 4 implies c; = 4.123. Next we 
find Q’(t) so that we can apply the condition Q’(0) = 0. Leaving this as an 
exercise, we find cg = 4.597. Therefore, the voltage on the capacitor is 


Q(t) = e~*(4.123 + 4.597t) — 0.158 sin 3t — 0.123 cos 3¢. 


As we observed, the first term, or transient, decays as time increases. There- 
fore we are left with only the oscillatory particular solution —0.158 sin 3t — 
0.123 cos 3t, which takes over in time. This is called the steady-state response 
of the circuit (Figure 2.6). 


Example 2.25 


Consider an LC circuit with a periodic emf sin 3t of frequency 3: 
Q” +9Q = sin 3t, 


where @ is the charge on the capacitor. The rules dictate the trial particular 
solution Q, = Asin3t + Bcos3t. Substituting into the differential equation 
yields 

—9Asin 3t — 9B cos 3t + 9Asin 3t + 9B cos 3t = sin 3t. 


But the terms on the left cancel completely and we get 0 = sin 3t, an absurdity. 
The method failed! To review, this result occurred because the homogeneous 
equation Q” + 9Q = 0 has eigenvalues \ = +37, which lead to independent 
solutions Q; = sin3t and Q2 = cos3t. Each of these has natural frequency 
equal to 3. The forcing term f(t) = sin 3t, which also has frequency 3, is not 
independent; it duplicates one of them and the method fails. The fact that we 
get 0 when we substitute our trial function into the equation is no surprise 


because it is a solution to the homogeneous equation. To remedy this problem 
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0 5 10 15 20 


Figure 2.6 A plot of the voltage Q(t) in Example 2.24. Initially there is a 
transient caused by the initial conditions. In time it decays away and is replaced 
by a steady-state response, an oscillation, that is caused by the forcing term. 


Figure 2.7 Solution Q(t) = cos3t+ an sin 3t— at cos 3t. The increasing ampli- 


tude of the oscillations is caused by driving the system at the same frequency 
as its natural frequency. This phenomenon is called resonance. 
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we use the rule and modify the trial guess by multiplying by t. So we look for 
a particular solution of the form 


Q, = t(Asin 3t + Bcos3t). 


Calculating the second derivative Or and substituting, along with Qp, into the 
original equation leads to (show this!) 


6A cos 3t — 6B sin 3t = sin 3t. 


Hence A = 0 and B = —1/6. So a particular solution is 
1 
Qp = a cos 3t, 


and the general solution of the original nonhomogeneous equation is the homo- 
geneous solution plus the particular solution, or 


1 
Q(t) = cy cos 3t + cg sin 3t — ae cos 3t. 


Next we apply the initial conditions to fix the arbitrary constants. If Q(0) = 1 
and Q’(0) = 0, then it is easy to show that cj = 1 and cp = 1/18. So, the 
solution to the initial value problem is 


1 1 
Q(t) = cos 3t + ig sin 3t — ru cos 3¢t. 


This solution is plotted in Figure 2.7. Observe that the solution to the homo- 
geneous equation is oscillatory and remains bounded; the particular solution, 
however, oscillates with increasing amplitude because of the time factor t mul- 
tiplying that term. This phenomenon is called resonance. It occurs because 
the forcing function sin 3t has frequency 3, which is the same as the natural 
frequency of the unforced system. This phenomenon is discussed in more detail 


in the next section. 


EXERCISES 


1. Each of the following functions represents a source term f(t) in a nonho- 
mogeneous equation. State the form of an initial trial guess for a particular 
solution 2,(t). 


a) 33 —1. e) 5sin 7t. i) 4t+5e-. 

b) 3cost — 2sint. f) e?*cost + t?. j) 5sin(2t) + te’. 
e). 12, g) te‘ sin nt. k) +1 -4t cost. 
dy Fe: h) (t+ 2) sin at. 1) —6 + 2e” sint. 


2. 


10. 


11. 


12. 
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Find the general solution of the following nonhomogeneous equations: 


a) 2” + 7x = te". e) x +2=9er*. 

b) 2” —a2' =6+e7*. f) #' +a =4e~. 

c) a +ar=t?. g) v” — 4x = cos 2t. 

d) x” — 3a’ — 4x = 2t?. h) a” + a/ + 2a = tsin 2. 


. Solve the initial value problem x” —ba'+a=sint, «(0)=0, w«'(0) =0, 


where 0 is a constant with b < 1. 


. Solve the initial value problem x” — 32’ — 40x = 2e~*, 2(0) = 0, 2’(0) = 1. 
. Find the solution of «” — 2a’ = 4, «(0) = 1, 2’(0) =0. 


. An undamped spring-mass system is driven by an external force cos V2t. 


The mass is m = 1 and the spring constant is k = 2. Initially, x(0) = 0 and 
x'(0) = 1. Find the general solution and plot it for 0 < t < 30. 


. Find the particular solution to the equation I” + J/ + 2I = sin*t? Hint: 


Use a trigonometry formula to rewrite the right side. 


. Solve y” + 2y’ =e7*, y(0) =1, y’(0) = 2. 


. A mass of 5 grams is attached to a spring with stiffness k = 2. The system 


is driven by an external force of 10 dynes. Initially the mass is displaced 
15 cm and given a velocity of 4 cm/sec. Find and plot the displacement of 
the mass for all times t > 0. 


An LC circuit contains a 107? farad capacitor in series with an aging 
battery of 5e~2! volts and an inductor of 0.4 henrys. At t = 0 both Q = 0 
and I = 0. Find the charge Q(t) on the capacitor and describe the response 
of the circuit in terms of transients and steady states. 


An RCL circuit contains a battery generating 110 volts. The resistance is 
16 ohms, the inductance is 2 henrys, and the capacitance is 0.02 farads. 
If Q(0) = 5 and J(0) = 0, find the charge Q(t) response of the circuit. 
Identify the transient solution and the steady-state response. 


An RCL circuit contains a aging battery generating 10e~*/1 volts. The 
resistance is 100 ohms, the inductance is 2 henrys, and the capacitance is 
0.001 farads. If Q(0) = Q’(0) = 0, find the charge Q(t) on the capacitor for 
t > 0 and sketch its graph. When does the maximum charge occur? 
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2.3.2 Resonance 


In this section we expand on the concept of resonance. See Example 2.25. 
The phenomenon of resonance is a key characteristic of vibrating systems. It 
occurs when the frequency of a forcing term has the same frequency as the 
natural oscillations in the system; it gives rise to large amplitude oscillations. 
Resonance can occur in circuits when a generator drives the system at its 
natural frequency, or it can occur in mechanical systems and structures where 
an external periodic force is applied at the same frequency as the system would 
naturally oscillate. The results could be disastrous, such as a blown circuit 
or a damaged building. Similarly, a bridge can have a natural frequency of 
oscillation and the wind can provide the forcing function. (See online videos of 
the Tacoma Narrows Bridge disaster.) 


Example 2.26 


Consider an LC circuit driven by a sinusoidal voltage source of frequency w. If 
L =1 and wé = 1/C, the governing equation for the charge on the capacitor 
has the form 

Q” + weQ =sinut. (2.16) 


Assume that wo 4 w and take initial conditions 
Q(0)=0, Q’(0) =1. 
The homogeneous equation has general solution 
Qh = C1 COSWot + Co Sin Wot, 


which represents oscillations of natural frequency wo. A particular solution has 
the form Q, = Asinwt. Substituting into the equation gives A = 1/(w? — w”). 
Therefore the general solution of (2.16) is 


1 
Q(t) = c1 coswot + cz sinwot + ——; sinut. (2.17) 
we — w 


At t =0 we have Q = 0 and so c; = 0. Also Q’(0) = 1 gives 


Therefore the response of the circuit is 


w+two(we—w) , 1 ; 
Q(t) = Ege Sines Sa aa sinwt. (2.18) 
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This solution shows that the charge response is a sum of two oscillations of 
different frequencies. If the forcing frequency w is close to the natural frequency 
wo, then the amplitude is bounded, but it is obviously large because of the factor 


wa — w* occurring in the denominator. Thus the system has large oscillations 


when w is close to wo. 


Example 2.27 


In the previous example, what happens if w = wo? Then the general solution 
in (2.17) is invalid because of division by zero; thus we have to re-solve the 
problem. The circuit equation is 


Q” + u2Q = sinwot, (2.19) 


where the circuit is forced at the same frequency as its natural frequency. The 
homogeneous solution is the same as before, but the particular solution now 
has the form 

Q,(t) = t(Asinwot + Bcos wot), 


with a factor of ¢ multiplying the terms. Therefore the general solution of (2.19) 
has the form 


Q(t) = cy coswot + co sinwot + t(Asinwot + B coswot). 


Without actually determining the constants, we can infer the nature of the 
response. Because of the ¢ factor in the particular solution, the amplitude of 
the oscillatory response Q(t) grows in time. This is the phenomenon of pure 
resonance, or mathematical resonance. It occurs when the frequency of the 


external force is the same as the natural frequency of the system. 


The previous example is an ideal case and physically unreasonable. All 
circuits have resistance, or dissipation, even though it may be small. We ask 
what happens if we include a small damping term in the circuit and still force 
it at its natural frequency. 


Example 2.28 


Consider 
Q" + 20Q' + 2Q = sin V2t, 
where 2c is a small. The homogeneous equation Q’” + 20Q’ + 2Q = 0 has 


solution 
Ogi =e" (c cos 2 — 02t+ cosin V2 — 0c? t) , 
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Now the particular solution has the form 
Qp(t) = Acos V2t + BsinvV2t, 
where A and B are constants. The solution, or response, of the circuit is 


Vee" (cr cos V2 — 0? t + ea sin 2— ot) + AcosV2t+ BsinV2t. 


The transient is a decaying oscillation of frequency 2 —o?, and the steady- 
state response is periodic of frequency V2. The solution will remain bounded, 
but its amplitude will be large if o is very small. See Figure 2.8. 


—2 kL. 

3 L \ 

Ar | 
0 10 20 30 40 50 60 


Figure 2.8 Plot of the solution of Q” + 0.2Q’ + 2Q = sin(/2t) with zero 
initial conditions. The system is driven at a frequency equal to the natural 
frequency, and there is small damping. 


EXERCISES 


1. Plot the solution (2.18) for several different values of 8 and w. Include 
values where these two frequencies are close. 


2. Find the solution in Example 2.27 if the initial conditions are Q(0) = 
Q'(0) = 0. 
3. Find the form of the general solution of the equation I” + 161 = cos 4t. 
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x 10 


Figure 2.9 Plot of the solution x(t) = 10~(cos(45t) — cos(55t)) to Exercise 
7(c) showing the phenomenon of beats. 


4. Consider a general LC circuit with input voltage Vo sin ft. If 6 and the 
capacitance C’ are known, what value of the inductance LD causes pure 
resonance? 


5. An undamped spring—mass system with m = 4 and and stiffness k is forced 
by a sinusoidal function 412 sin 5¢. What value of k causes pure resonance? 


6. Consider a spring—mass system with small damping and driven by a cosine 
force: 
x’ +0.012’ + 4x =cos2t, 2x(0) =0, 2’'(0) =0. 
Find the solution and plot the result. 


7. Consider the equation 
a” + wx = cos ft. 


a) Find the solution when the initial conditions are x(0) = 2’(0) = 0 when 
w HB. 
b) Use the trigonometric identity 2 sin Asin B = cos(A — B) — cos(A+ B) 


to write the solution as a product of sines. 


c) Take w = 55 and 8 = 45 and plot the solution from part (b) on 
the time interval [0,4]. The solution can be interpreted as a high fre- 
quency response contained in a low frequency amplitude envelope. We 
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say the high frequency is modulated by the low frequency. This is the 
phenomenon of beats. What is the high frequency and low frequency 
modulation? A plot of the solution is shown in Figure 2.9. 


2.4 Equations with Variable Coefficients 


Second-order linear equations with given variable coefficients p(t) and q(t) have 
the form 

x" + p(t)x' + q(t)x = f(t). (2.20) 
Except for a few cases, these equations cannot be solved in analytic form using 
familiar functions. Even the simplest equation, Airy’s equation, 


x" —ta =0, 


requires a new class of transcendental functions, called Airy functions, to char- 
acterize the solutions. Nonetheless, there is a well developed theory for variable 
coefficient equations, and we list some of the main results. 

We assume that the coefficients p(t) and q(t), as well as the forcing term 
f(t), are continuous functions on the interval J of interest. The following prop- 
erties are the same ones shared by second-order, constant coefficient equations 
studied in Section 2.2. 


1. (Existence-Uniqueness) If J is an open interval and to belongs to J, then 
the initial value problem 
x" + p(t)x’ + q(é)a = fd), (2.21) 
t(to) =a, 2'(to) =), (2.22) 
has a unique solution on I. 


2. (The Homogeneous Equation) If x; and x2 are independent solutions 
of the associated homogeneous equation 


x” + p(t)a’ + q(t)x = 0 (2.23) 
on an interval J, then 
x(t) = c1a1(t) + coxe(t) 


for any constants c, and c2 is a solution of (2.23) on the interval J and is 
called the general solution to (2.23). The general solution contains all 
solutions of the homogeneous equation for various choices of the constants. 


2.4 Equations with Variable Coefficients 117 


3. (Nonhomogeneous Equation) All solutions to the nonhomogeneous 
equation (2.21) can be represented as the sum of the general solution to 
the homogeneous equation (2.23) and any particular solution z,(t) to the 
nonhomogeneous equation (2.21). In symbols, 


a(t) = cyx1(t) + cove(t) + a(t), 
which is called the general solution to (2.21). 


One difficulty, of course, is to find two independent solutions x1(t) and 
x2(t) to the homogeneous equation. This task is not easily accomplished for 
equations with variable coefficients. The method of writing down the charac- 
teristic polynomial, as we did for constant coefficient equations, does not work. 
A method that applies to many of these types of problems is called the power 
series method. Basically, the idea is to assume the solution has the form of a 
infinite power series, which we substitute it into the equation and determine 
relations for the coefficients. This topic is not covered in this text, and we 
refer to the references for a complete discussion. For example, see Brannan and 
Boyce (2011). 


2.4.1 Cauchy—Euler Equations 


One equation that can be solved analytically has the form 


or 

x” + bta’ + cx = 0, (2.24) 
which is called a Cauchy—Euler equation. In each term the exponent on t 
coincides with the order of the derivative. Observe that we must avoid t = 0 in 
our interval of solution, because p(t) = b/t and q(t) = c/t? are not continuous 
at t = 0. We try to find a solution of the form of a power function x(t) =t™. 
Think about why this might work—each term in (2.24) will then have the same 
power of ¢t, namely, t’”. Substituting gives the the indicial equation 


m(m—1)+bm+c=0, 


which is a quadratic equation for the exponent m. 
There are three cases. 


(1) If there are two distinct real roots m, and mz, then we obtain two 
independent solutions ¢’! and t’”?. Therefore the general solution is 


x(t) =ct™! + cot™. 
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(2) If there are two equal roots m; = m2 = ™m, then t™ and t’™ Int are two 
independent solutions and the general solution is 


a(t) =ct™ + cot™ Int. 


(3) If the two roots are complex conjugates, m = a+i{, we note, using the 
properties of logarithms, exponentials, and Euler’s formula, that a complex 
solution is 


£7 = totiB — yogi8 — pment? _ yoeih nt _ 4°/¢95(8 Int) + isin(B Int)]. 


The real and imaginary parts of this complex function are therefore real 
solutions (proved earlier), so the general solution in the complex case is 


x(t) = cyt* cos(8 Int) + cgt™ sin(f Int). 


Figure 2.10 shows a graph of the function sin(5 Int), which is a type appear- 
ing in the solution in the complex case (3). Note that this function oscillates 
less and less as t gets large because Int grows very slowly. As t nears zero it 
oscillates infinitely many times. Because of the scale, these rapid oscillations 
are not apparent on the plot. Initial conditions are never given at t = 0. 


1 | ) 


0.5, 


Figure 2.10 Plot of z = sin(5In¢), which oscillates infinitely many times 
near the origin. 
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Example 2.29 


Consider the equation 
tae” + te’ + 9x =0. 


The indicial equation is m(m— 1) +m+9 = 0, which has roots m = +3i. The 
general solution is therefore 


x(t) = c, cos(3 Int) + cz sin(3 Int). 


Example 2.30 


Consider the equation 


2 
vg! = =a". 
t 


We can write this in Cauchy—Euler form as 
t?x” — 2tx’ = 0, 


which has indicial equation m(m — 1) — 2m = 0. The roots are m = 0 and 
m = 3. Therefore the general solution is 


z(t) = ce, + eet?. 


Example 2.31 
Solve the initial value problem 
Po" +32’ +2=0, x(1)=0, 2'(1)=2. 


The indicial equation is m(m — 1) + 3m +1 = 0, and it has a double root 
m = —1; so the general solution is 


Cl C2 
t)=—+—lInt. 
x(t) ; + ; in 


Now, x(1) = c, = 0 and so a(t) = cg (tlnt). Taking the derivative, x’(t) = 
2/(t?(1 — Int)). Then 2’(1) = cg = 2. Hence, the solution to the initial value 
problem is 


2 
a(t) = ; Int. 


A. Cauchy (1789-1857) and L. Euler (1707-1783) were renown mathemati- 
cians who left an indelible mark on the history of mathematics and science. 
Their names are encountered often in advanced courses in mathematics, sci- 
ence, and engineering. 
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EXERCISES 


1. Solve the following problems as indicated: 


gl! = —ge. f) t?x" + 3ta’ — 8x2 = 0, 


x(1) =0, #’(1) =2. 


g) a" +ta’ =0, 
x(1) =0, #’(1) =2. 


h) t?2" — ta’ + 2x =0, 
t22"” — 7tx' + 16x = 0. x(1) =0, a’(1) =1. 


2. Solve the initial value problem 2” + t?z’ = 0, x(0) = 0, 2’(0) = 1. Is this 
a Cauchy—Euler equation? 


3. This exercise presents a method for solving a Cauchy—Euler equation using 
a change of the independent variable. Show that the transformation 7 = Int 
to a new independent variable 7 transforms the Cauchy—Euler equation 
at?x" + bta’ +cax = 0 into an linear equation with constant coefficients. Use 
this method to solve Exercise la. 


4. Find the general solution to the equation a(t)x” + a’(t)a’ = f(t). Your 
answer should be expressed in terms of integrals. 


2.4.2 Variation of Parameters 


There is a general formula, called the variation of parameters formula, for the 
particular solution to a nonhomogeneous linear equation 


2" + p(t)e! + q(t)x = f(t). (2.25) 


It requires knowledge of a pair of fundamental solutions of the homogeneous 
equation. 
The idea is as follows. Let x(t) and x2(t) be independent solutions to the 

homogeneous equation 

x” + p(t)a’ + q(t)x = 0. 
Then 

xp (t) = e141 (t) + cor2(t) 
is the general solution of the homogeneous equation. To find a particular solu- 
tion we assume that c; and ce vary as functions of time t, and take 


Lp(t) = er (t)a1(t) + co(t)ro(F), (2.26) 
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where now ci(t) and co(t) are functions to be determined. (Hence the term 
variation of parameters.) Substituting this expression into the nonhomogeneous 
equation to obtain expressions for c;(t) and c(t) is a tedious task in calculus 
and algebra, and we leave most of the details to the reader. Here is how the 
argument goes. We calculate x, and «} and substitute into the equation. For 
notational simplicity, we drop the t variable in all of the functions. We have 


if / / / 
Ly = CX, + CQ%y + 1X1 + CyoXQ. 


P 
Let us set 
Ct + hx = 0. (2.27) 
Then 
‘a = (2, + 2X5, 
wy = C12 + cotg + cry t+ cpr). 


Substituting these into the nonhomogeneous differential equation gives 


cay + coms + Chay + char + p(t)[era, + coa’] + q(t)[ere1 + cow] = f(t). 


Because x; and x2 both satisfy the homogeneous equation, the last equation 
simplifies to 

ca, + hah = f(t). (2.28) 
Equations (2.27) and (2.28) form a system of two linear algebraic equations in 
the two unknowns cand c}. If we solve these equations simultaneously and 
then integrate, we finally obtain (readers should fill in the details) 


c(t) = — / at co(t) = i: at (2.29) 


where 
W(t) = x1 (t)a'g(t) — 24 (t)wo(t). 
The expression W(t) is called the Wronskian. Combining the previous expres- 


sions gives the variation of parameters formula for the particular solution 
of (2.25): 
v(t) f(t) i vi(t) f(t) 
== —————dt t ——— dt. 2. 
p(t) =—an(t) f Rat + oat f OR (2.30) 
The general solution of (2.25) is the homogeneous solution x,(t) plus this par- 
ticular solution x,(t). If the antiderivatives in (2.30) cannot be computed explic- 
itly, then the integrals in (2.30) should be written with variable upper limits of 
integration: 
t t 
v2(s) f(s) v1(s) f(s) 
at ait i ry is tat) fas 


Finally, we summarize with the following result. 
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Theorem 2.32 

The general solution to the nonhomogeneous equation 
x" + p(t)’ + q(t)a = f(t) 

is 


a(t) = cai (t) + c2x2(t) — nil [ eas + vat) f wa(s) f(s) ds, 


where c; and cg are arbitrary constants and 21(t) and x2(t) are independent 
solutions to the homogeneous equation. 


Example 2.33 


Find a particular solution to the DE 
x” + 9x = 3sec 3t. 


Notice this forcing term is not of the type applicable for the method of undeter- 
mined coefficients. The homogeneous equation 7” +92 = 0 has two independent 
solutions, x; = cos3t and x2 = sin 3t. The Wronskian is 


W(t) = 3cos? 3t + 3sin? 3t = 3. 


Therefore, using (2.29), 


_ my 
c(t) = — [PBB oie = [ARSE 


Simplifying, 


1 
c(t) = = [ tan 3tdt = 3 In(cos 3t), c(t) = joa =. 


We do not need constants of integration because we seek only the particular 
solution. Therefore the particular solution is 


1 
to(t) = 3 In(cos 3t) + t sin 3¢t. 
The general solution is therefore 


1 
x(t) = cy cos 3t + co sin 3t + 3 In(cos 3t) + tsin 3¢. 


The constants are determined by initial data, if given. 
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Remark 2.34 


If there are homogeneous initial conditions 7(0) = x’(0) = 0, then the general 
solution given in Theorem 2.32 implies cj = cz = 0. The solution to the initial 
value problem 


2” + p(t)a’ +q(t)x = f(t), 2(0) =0, 2'(0) =0 


is therefore 


re -[ —21(t)a9(s) + #1(3)%2() 4/4) ee 


W(s) 
If we denote . 
G(t,s) = ot 


then the solution takes the simple form 


x(t) -{ Git, s) f(s)ds. (2.31) 


The function G(t,s) is called the causal Green’s function, or the influ- 
ence function. In higher mathematics this approach plays an essential role in 
understanding the structure of equations. Briefly, the differential equation can 
be thought of as an operator equation 


La(t) = f(t), 
where P F 
b= + po + alt) 


is a differential operator. Then (2.31) expresses the fact that the solution can 
be formulated as 


a(t) = L~" f(t) 
where L~!, an integral operator, is the inverse of the differential operator L. 


The scope of these ideas is difficult to imagine at this time, but the idea is 
central in unifying the theory of linear equations of all types. 


In summary, when a second-order equation has constant coefficients and the 
forcing term is polynomial, exponential, a sine or cosine, or some combination, 
then the method of undetermined coefficients may work more easily than vari- 
ation of parameters. Of course, the easiest method of all is to use a computer 
algebra system. After we have paid our dues by applying analytic methods to 
many problems, then we have our license and may use a computer algebra sys- 
tem. The variation of parameters formula is important because it is often used 
in the theoretical analysis of problems in advanced differential equations. 
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EXERCISES 


1. Use the variation of parameters formula to find a particular solution to the 
following equations. 


a) 2” +a =tant. da = lee, 
b) #” —a2 = te’. e) a" +a = py. 
CLE tes: f) 2” — 22 +2 = He’. 


2. Find the general solution of the equation alia! = a, where a is a constant. 
3. Find the general solution of the equation t?x” — 3ta’ + 3x = 4t". 


4. Let x; = 2(t) and x2 = x(t) be independent solutions of the linear 
equation x” + p(t)a’ + q(t)e = 0 on an interval J and let W(t) be the 
Wronskian of x; and 22. 


a) By direct differentiation show that the Wronskian satisfies the differ- 
ential equation W'(t) = —p(t)W(t). 

b) Solve this equation for W(t) and show that either W(t) = 0 for all 
t € I, or W(t) is never zero on I. 


c) Ift =a and t = b are two adjacent zeros of x1(t), ie., e1(@) = #1(b) = 
0, show that x(t) must have a zero between a and b. Hint: Use part 
(b). 

5. Let Lx = x” + pa’ + cx, where p and q are constant, be a differential 
expression. Suppose « = ¢(t) is a solution to Lé = 0, with ¢(0) = 
0, (0) = 1. Show that a particular solution to La = f(t) is given by 
Zp(t) = fe g(t — s)f(s)ds, where a is any constant. Hint: Leibniz rule, 
Exercise 17 Sec. 1.2. 


6. Use the method of the previous problem to find a particular solution to the 
equation x” — 2ma’ + m?x = f(t). Hint: Take 6(t) = te™®. 


7. Find a particular solution of 2” — 7 = e'/(1+e°). 


2.4.3 Reduction of Order* 


If one solution x(t) of 
x” + p(t)a’ + q(t)x =0 
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is known, then a second, linearly independent solution x2(t) can be found of 
the form 


xo(t) = v(t)a (t) 


for some v = v(t) to be determined. To determine u(t) we substitute this form 
for x(t) into the differential equation to obtain a second-order equation for 
v(t) which can be immediately reduced to a first-order equation. The method 
is called reduction of order; we illustrate it with a simple example. 


Example 2.35 


Consider the equation 


Mu 


TG cat 
An obvious solution is x1 (t) =t. So let x2 = v(t)t. Substituting, we get 
/ iW 1 / 1 
(2u' + tu”) — qu t tu!) + gut =0, 


which simplifies to 
tu” +v' =0. 
Letting w = v’, we get the first-order equation 


tw’ +w=0. 


Separating variables and integrating easily gives w = 1/t. Hence v = [(1/t)dt = 
Int, and the second independent solution is x2(t) = tInt. Consequently, the 
general solution of the equation is 


x(t) = cyt + cot Int. 


Note that this example is a Cauchy—Euler equation with equal roots m = 1, 1 
of the indicial equation. It exposes our choice of t Int as the second independent 
solution. 


EXERCISES 


—t?/2 


1. Find the general solution of x” + ta’ + « = 0 given that « = e is one 


solution. 


2. Show that x(t) = t is a solution of the equation x” — ta’ + x = 0. Use 
reduction of order to find a second solution x2(t). 
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(a) For what value(s) of 6 is x = t® a solution to the Legendre equation 
(1 —¢t?)a” — 2ta’ + 2x = 0? (b) Find the general solution to this equation. 
Hint: Use part (a) and reduction of order to show 


t l+a 
2 1-2 


is a solution. 


Consider the equation x” — 2az’ + a?x = 0, which has solution 2 = e*. Use 
reduction of order to find a second independent solution. (This shows the 
origin of the te®’ solution in a second-order linear equation with constant 
coefficients, in the real, equal eigenvalue case.) 
One solution of 
gl! _ Che) + t + 2 
t t? 


is ,(t) = t. Find a second independent solution. 


xr=0 


One solution of Bessel’s equation 
2/1 / 2 i 
ta’ +ta + (t — ri x=0 


is x1(t) = cost/Vt. Find a second independent solution. 


Let y(t) be one solution of the equation 7” + p(t)2’ + q(t) = 0. Show that 
the reduction of order method with x(t) = z(t)y(t) leads to the first-order 
linear equation 


/ 


yz +(2y'+py)z=0, z=". 


Show that 
Ce J pleat 


y(t)? 
and then find a second linear independent solution of the equation in the 
form of an integral. 


ae = 


Use ideas from the last exercise to find a second-order linear equation that 
has independent solutions e* and cost. 


Consider the second-order equation 
x” + p(t)a’ + q(t)x = 0. (2.32) 


a) Use the transformation « = exp (f y(t)dt) to convert this equation to 
a Riccati equation 


y +y? + p(t)y + g(t) = 0. 
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b) Conversely, show that the Riccati equation can be reduced to (2.32) 
using the transformation y = 2’ /x. 


c) Solve the first-order equation 


/ 


3 
— £472 = 
y= + Fy: 


d) Solve the equation 
y' + ay = —by* +e 


using the transformation y = 2’ /bx. 


e) A chemical C in a reactor undergoes the reaction 2C products. Solve 
the chemical reactor equation 


VC =q(Cn—C)—kVC*. 


2.5 Higher-Order Equations* 


So far we have dealt with first- and second-order equations. Higher-order equa- 
tions occur in some applications. For example, in solid mechanics the vertical 
deflection y = y(x) of a beam from its equilibrium satisfies a fourth-order equa- 
tion. However, the applications of higher-order equations are not as extensive 
as those for their first- and second-order counterparts. 

Here, we outline the basic results for a linear, nth-order equation with con- 
stant coefficients. We will observe that the method we used for second-order 
equations extends easily to the higher order case. Consider 


a” Ap en!) feee Ht pia’ + pox = 0, (2.33) 


where the p;, 7 = 0,1,...,n—1, are specified constants. The general solution of 
(2.33) has the form 


a(t) = c1x1(t) + cove(t) +--+ + nen (t), 


where x(t), v2(t), ..., &,(t) are independent solutions, and cy, C2, ..., Cn are arbi- 
trary constants. Hence, the general solution is a linear combination of n differ- 
ent basic solutions. To find these basic solutions we adopt the same strategy 
as earlier and assume a solution of the form of an exponential function 


sie", 
where X is to be determined. Substituting into the equation gives 


XN” + pn" + +++ + pid t+ po = 0, (2.34) 
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which is an nth-degree polynomial equation for A. Equation (2.34) is the char- 
acteristic equation. From algebra we know there are n roots 1, A2,..-; An- 
As before, we call these eigenvalues. Here we are counting multiple roots and 
complex roots, the latter of which occur in complex conjugate pairs a + bi. A 
root \=a has multiplicity K if (\—a)* appears in the factorization of the 
characteristic polynomial. 


Of course, the roots for higher order polynomial equations cannot, in gen- 
eral, be found by a formula unless the equation is extremely simple. Therefore, 
we often resort to computer software to find them. 

If the roots are all real and distinct, we obtain n different basic solutions 
x(t) = e*1", xo(t) = e*2*,...,2,(t) = e*”*. In this case the general solution of 
(2.33) is a linear combination of these, 


w(t) = cre™** + ege™* $--- t ene’. (2.35) 


If some roots of (2.34) are not real, then we proceed as expected from the 
study of second-order equations. A complex conjugate pair, \ = a+ib gives rise 
to two real solutions e* cos bt and e® sin bt. A real, double root 4 (multiplicity 
2) leads to two solutions e** and te**. A root A of multiplicity 3 leads to 
three independent solutions, e**, te*’, t?e* 
we can build up n basic solutions from the factorization of the characteristic 
polynomial (2.34). 

The general solution of an nth-order nonhomogeneous equation of the form 


, and so on. Proceeding in this way 


Pau) py a) feee Ht pix! + port = g(t), (2.36) 


is the sum of the general solution of the homogeneous equation (2.33) and a 
particular solution to the equation (2.36). This result is in fact true even if the 
coefficients p; are functions of t. For the constant coefficient case, the particular 
solution can be found using the method of undetermined coefficients in exactly 
the same way as for second-order equations. 


Example 2.36 


If the characteristic equation for a sixth-order equation has eigenvalues \ = 
—2+372,4,4,4,—1, the general solution is 


t 


x(t) = ce cos 3t + cpe~** sin 3t + ese + cate + cgt7e** + ce 


Example 2.37 


Find a differential equation whose basic solutions are e*’, te**, and e~*. The 
characteristic roots or eigenvalues are A = 3, 3, and —1. So, 3 is a root of 
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multiplicity two. Therefore the characteristic equation must be 
(A—3)2(A +1) =0. 


Expanding, we get 
N= 5? +3A4-9=0. 


Therefore the differential equation is 


al” — 5a!’ + 3a’ + 9a = 0. 


Initial conditions for an nth-order equation (2.33) at t = 0 take the form 
z(0)=a1, 2'(0) =a9,..., 2-0) = an-_1, 


where the qa; are given constants. Thus, for an nth-order initial value problem 
we specify the value of the function and all of its derivatives up to the (n—1)st- 
order, at the initial time. These initial conditions determine the n arbitrary 
constants in the general solution and select a unique solution to the initial 
value problem. 


Example 2.38 
Consider the nonhomogeneous 
g” — Io" — 3g" = 5e™*, 
The characteristic equation for the homogeneous equation is 
r° — 2d? — 31 =0, 
or 
MA — 38)(A + 1) = 0. 
The eigenvalues are \ = 0, —1,3, and therefore the homogeneous equation has 
solution 
xp,(t) =e, +cge* + c3e*". 
The particular solution will have the form x,(t) = ae*’. Substituting into the 
original nonhomogeneous equation gives a = 1/4. Therefore the general solution 
to the equation is 
-t ae, Lae 
x(t) =c1 tee * +c3e"" + 7° . 


The three constants can now be determined from initial conditions. For exam- 
ple, for a third-order equation the initial conditions at time t = 0 have the 
form 


rO=a, £03; a 0)=—%, 


for some given constants a, 8, y. Of course, initial conditions can be prescribed 


at any other time to. 
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EXERCISES 


1. Find the general solution of the following differential equations. 


a) a!” +a'=0. d) «!” —2'-8r=0. 
b) a!” +a =1. e) al” + 2" = et + 3t?. 
c) al” +2" =0. f) 2” — 8x =0. 


2. Solve the initial value problem a2!” + x” — 42’ — 4x = 0, x(0) = 1, 2’(0) = 0, 
x" (0) = —1. Hint: Guess one eigenvalue. 


3. Write a linear, fourth-order differential equation whose general solution is 


x(t) = cy + cot + e*(c4 cos 2t + cs sin 5t). 


4. What is the general solution of a fourth-order differential equation if the 
four eigenvalues are \ = 347, 347? What is the differential equation? 


2.6 Steady-State Heat Conduction* 


Let us consider the following problem in steady-state heat conduction. A cylin- 
drical, uniform, metallic bar of length L and cross-sectional area A is insulated 
on its lateral side. We assume the left face at x = 0 is maintained at To degrees 
and that the right face at « = LD is held at Ty, degrees. What is the tempera- 
ture distribution u = u(x) in the bar after it comes to equilibrium? Here u(z) 
represents the temperature of the entire cross-section of the bar at position 2, 
where 0 < a < L. We are assuming that heat flows only in the axial direction 
along the bar, and any transients caused by initial temperatures in the bar have 
decayed away. In other words, we have waited long enough for the temperature 
to reach a steady state. One can conjecture that the temperature distribution 
is a linear function of x along the bar; that is, u(x) = To + ((Tr — To)/L)a. 
This is indeed the case, which we show below. But also we want to consider 
more complicated problems where the bar has both a variable conductivity and 
an internal heat source along its length. An internal heat source, for example, 
could be resistive heating produced by a current running through the bar. 
The physical law providing the basic model is conservation of energy. If 
[x, x + dz] is any small section of the bar, then the rate that heat flows in at 2, 
minus the rate that heat flows out at x+dz, plus the rate that heat is generated 
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laterally insulated 


/ ( 
Ad(x) —s Ad(x + dx) 
\ \ 
\ q 
® } } | > Xx 


0 x xtdx L 


Figure 2.11 Cylindrical bar, laterally insulated, through which heat is flowing 
in the x-direction. The temperature is uniform in a fixed cross-section at x. 


by sources, must equal zero, because the system is in a steady state. Refer to 
Figure 2.11. 

If we denote by (x) the rate that heat flows to the right at any section 2, 
measured in calories/(area: time), and we let f(x) denote the rate that heat is 
internally produced at x, measured in calories/(volume: time), then 


Adg(x) — Ad(x + dx) + f(x) Adz =0. 
Canceling A, dividing by dz, and rearranging gives 


d(x + dx) — o(z) 
dx 


Taking the limit as dz — 0 yields 


(x) = f(a). (2.37) 


This is an expression of energy conservation in terms of flux. But what about 


= f(z). 


temperature? Empirically, the flux é(x) at a section x is found to be pro- 
portional to the negative temperature gradient —u’(x) (which measures the 
steepness of the temperature distribution, or profile, at that point), or 


(x) = —K(ax)u' (2). (2.38) 


This is Fourier’s heat conduction law. The given proportionality factor 
K(a) is called the thermal conductivity, in units of energy /(length - degrees - time), 
which is a measure of how well the bar conducts heat at location x. For a uni- 
form bar K is constant. The minus sign in (2.38) means that heat flows from 
higher temperatures to lower temperatures. Fourier’s law seems intuitively cor- 
rect and it conforms with the second law of thermodynamics; the larger the 
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temperature gradient, the faster heat flows from high to low temperatures. 
Combining (2.37) and (2.38) leads to the equation 


—(K(a)u' (a) = f(z), O<2< ZL, (2.39) 


which is the steady-state heat conduction equation. When the boundary 
conditions 


u(0)=T, u(L) =Th, (2.40) 


are appended to (2.39), we obtain a boundary value problem for the tem- 
perature u(x). Boundary conditions are conditions imposed on the unknown 
state u given at different values of the independent variable x, unlike initial 
conditions that are imposed at a single value. For boundary value problems we 
usually use x as the independent variable because boundary conditions refer to 
the boundary of a spatial domain; typically, boundary value problems describe 
steady-state phenomena where the solution is time-independent. 
Note that we can expand the heat conduction equation as 


—K(x)u" (x) — K"(a)u'(a) = f(a), 


but there is little advantage in doing so. 


Example 2.39 


If there are no sources (f(a) = 0) and if the thermal conductivity K(x) = Kk 
is constant, then the boundary value problem is simply 


u”=0, O0<2<L, 
u(0) => To, u(L) = Ti. 


Thus the bar is homogeneous and can be characterized by a constant conduc- 
tivity. The general solution of u” = 0 is u(x) = c1@+c2. Applying the boundary 
conditions determines the constants c, and cg and gives the linear temperature 


distribution 
Tr — To 
——— 4 


u(a) =To+ i ; 


as previously conjectured. 


In nonuniform systems the thermal conductivity K depends upon location 
x. Similarly, K may depend upon the temperature u. Moreover, the heat source 
term f can depend on location and temperature. In these cases the steady-state 
heat conduction equation (2.39) takes the more general form 


—(K(z, u)u’y’ = f(x,u), 
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which is a nonlinear second-order equation for the steady-state temperature 
distribution u = u(z). 

Boundary conditions at the ends of the bar may specify the flux rather than 
the temperature. For example, in a homogeneous system, if heat is injected at 
x = Oat arate of N calories per area per time, then the left boundary condition 
takes the form $(0) = N, or 


—Ku' (0) =N. 


This flux condition at an endpoint imposes a condition on the derivative of 
the temperature at that endpoint. In the case that an end, say at x = JL, is 
insulated, so that no heat passes through that end, then the boundary condition 
is 


which is called an insulated boundary condition. As the reader can see, 
there are a myriad of interesting boundary value problems associated with heat 
flow. Similar equations arise in diffusion processes in biology and chemistry, for 
example, in the diffusion of toxic substances where the unknown is the chemical 
concentration. 

Boundary value problems are much different from initial value problems in 
that they may have no solution, or they may have infinitely many solutions. 


Example 2.40 


When Kk = 1 and the heat source term is f(u) = 9u and both ends of a bar of 
length L = 2 are held at u = 0 degrees, the boundary value problem becomes 


—u =9u, 0<2<2, 
u(0) =0, u(2) =0. 


The general solution to the DE is u(x) = c; sin3a + cg cos3a, where c, and 
cg are arbitrary constants. Applying the boundary condition at x = 0 gives 
u(0) = c, sin(3 - 0) + c2cos(3- 0) = co = 0. So the solution must have the 
form u(x) = cy, sin3a. Next apply the boundary condition at « = 2. Then 
u(2) = c, sin(6) = 0, to obtain c, = 0. We have shown that the only solution 
is u(x) = 0. There is no nontrivial steady state. But if we make the bar length 
am, then we obtain the boundary value problem 


—u"=9u, O0<a<r7, 
u(0) = u(r) = 0. 
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The reader should check that this boundary value problem has infinitely many 
solutions u(a) = c,sin3x, where c, is any number. If we change the right 
boundary condition, one can check that the boundary value problem 


-u"=9u, 0<a<r7, 
u(0)=0, ulm) =1, 


has no solution at all. 


Example 2.41 

Find all real values of A for which the boundary value problem 
—u" =u, 0<a<7, (2.41) 
u(0)=0, u(r) =0, (2.42) 


has a nontrivial solution. These values are called the eigenvalues, and the 
corresponding nontrivial solutions are called the eigenfunctions. Interpreted 
in the heat flow context, the left boundary is held at zero degrees and the right 
end is insulated. The heat source is f(uw) = Au. We are trying to find which 
linear heat sources lead to physically meaningful, nontrivial steady states. 

To solve this problem we consider different cases because the form of the 
solution has a different form for \ = 0, A < 0, A > 0. If A = 0 then the general 
solution of u” = 0 is u(#) = az + b. Then u’(x) = a. The boundary condition 
u(0) = 0 implies b = 0 and the boundary condition u’(7) = 0 implies a = 0. 
Therefore, when \ = 0, we get only a trivial solution. Next consider the case 
A <0 so that the general solution has the form 


u(t) = asinh V—Ax + bcosh V—Az. 


The condition u(0) = 0 forces b = 0. Then u!(t) = a/—X cosh /—Azx. The right 
boundary condition becomes u!(m) = av/—Xcosh(V—X - 0) = 0, giving a = 0. 
Recall that cosh0 = 1. Again there is only the trivial solution. Finally assume 
A > 0. Then the general solution takes the form 


u(t) = asin VAx + bcos VAx. 


The boundary condition u(0) = 0 forces b = 0. Then u(t) = asin Ax and 
u(x) = aVXcos VAx. Applying the right boundary condition gives 


ul (x) = aVXcos Vr = 0. 


Now we do not have to choose a = 0 (which would again give the trivial 
solution) because we can satisfy this last condition with 


cos V\r = 0. 
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The cosine function is zero at the values 7/2 + nz, n = 0,1,2,3,.... Therefore 
Vixn = 1/2+n1, n =0,1,2,3,... 


Solving for A yields 


Consequently, the values of for which the original boundary value problem 


1,925. |... These are the eigenvalues. The corre- 


has a nontrivial solution are 7,5, 4,-. 


sponding solutions are 


2n+1 


uz) = asin ( Je n =0,1,2,3,.... 

These are the eigenfunctions. Notice that the eigenfunctions are unique only 
up to a constant multiple. In terms of heat flow, the eigenfunctions represent 
possible steady-state temperature profiles in the bar. The eigenvalues are those 
values » for which the boundary value problem has steady-state profiles. 


Boundary value problems are of great interest in applied mathematics, sci- 
ence, and engineering. They arise in many contexts other than heat flow, includ- 
ing wave motion, quantum mechanics, and the solution of partial differential 
equations. 


EXERCISES 


1. A homogeneous bar of length 40 cm has its left and right ends held at 
30°C and 10°C, respectively. If the temperature in the bar is in steady 
state, what is the temperature in the cross-section 12 cm from the left 
end? If the thermal conductivity is K, what is the rate that heat is leaving 
the bar at its right face? 


2. The thermal conductivity of a bar of length LZ = 20 and cross-sectional 
area A = 2 is K(a#) = 1, and an internal heat source is given by f(x) = 
0.5a(L — x). If both ends of the bar are maintained at zero degrees, what 
is the steady-state temperature distribution in the bar? Sketch a graph of 
u(az). What is the rate that heat is leaving the bar at 7 = 20? 


3. For a metal bar of length LZ with no heat source and thermal conductivity 
K (a), show that the steady temperature in the bar has the form 


oy eee 
ula) =er fe en, 


where c; and c2 are constants. What is the temperature distribution if both 
ends of the bar are held at zero degrees? Find an analytic formula and plot 
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the temperature distribution in the case that K(x) =1+ a. If the left end 
is held at zero degrees and the right end is insulated, find the temperature 
distribution and plot it. 


. Determine the values of A for which the boundary value problem 


-u"=\, O0<2<1, 
u(0) = u(1) = 0, 


has a nontrivial solution. 


. Consider the nonlinear heat flow problem 


(uu’)’=0, O0<a<z, 
u(0)= 0; u'r) =A, 


where the thermal conductivity depends on temperature and is given by 
K(u) =u. Find the steady-state temperature distribution. 


. Find all values of A for which the boundary value problem 


—u" —2u’ =u, 0<a2<1, 
u(0)=0, wu(1) =0, 


has a nontrivial solution. 


. Show that the eigenvalues of the boundary value problem 


-u"=\M, O0<a2<1, 
u'(0)=0, wu(1)+u'(1) =0, 


are given by the numbers A, = p?, n = 1,2,3,..., where the pn, are roots 
of the equation tanp = 1/p. Plot graphs of tanp and 1/p and indicate 
graphically the locations of the values p,. Numerically calculate the first 
four eigenvalues. 


. Find the values of \ (eigenvalues) for which the boundary value problem 


—a?ul —gu' =u, 1<a2<e™; u(1)=0, u(e™) =0, 


has a nontrivial solution. Hint: This is a Cauchy—Euler equation. 


. In groundwater studies one encounters the nonlinear boundary value prob- 


lem (Dupuis—Forchheimer equation) 
K 
z (h?)’ =-q, h(0)=ho, A(L) = hu, 


where q is the rainfall accretion rate, K is the hydraulic conductivity, and 
h = h(a) is the hydraulic head. Find a formula for h. 


3 


Laplace Transforms 


In this chapter we introduce a dramatically different technique called the 
Laplace transform method, for solving the linear, nonhomogeneous equation 


ax" + ba’! +cx = f(t), 2x(0) =20, 2'(0) =21, 


where a, b, and c are constant coefficients. The method is based upon trans- 
forming the differential equation into an algebraic equation, and it is especially 
applicable to equations containing a nonhomogeneous forcing term f(t) that is 
either discontinuous or a force that is applied only at a single instant of time (an 
impulse). The methods introduced in Chapter 2, undetermined coefficients and 
variation of parameters, are extremely inadequate in these physically impor- 
tant cases. Moreover, transform methods are one of the most important tools 
in all of mathematics and the pure and applied sciences. They are applicable 
to ordinary and partial differential equations, integral equations, and they are 
a key component in understanding the stability characteristics of feedback con- 
trol systems. These are standard methods for engineers, physicists, and applied 
mathematicians. 

The transform goes back to the late 1700s and is named for the great French 
mathematician and scientist Pierre de Laplace, although some of the basic defi- 
nitions go back earlier to Leonard Euler. The English engineer Oliver Heaviside 
developed much of the operational calculus for transform methods in the early 
1900s. 

The material in this chapter is independent from the remaining chapters, 
so it may be read at any time. 
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3.1 Definition and Basic Properties 


A successful strategy in many problems is to transform them into simpler ones 
that can be solved more easily. Many differential equations can can be handled 
in this way using integral transform methods. The Laplace transform, which is 
one of several transforms used in differential equations, has the effect of turning 
a differential equation with state function « = x(t) into an algebraic equation 
for an associated transformed function X = X(s); we can easily solve for X(s) 
and then return to z(t) via an inverse transformation. 


Definition 3.1 


Let « = x(t) be a given function defined on the interval 0 < t < oo. The 
Laplace transform of x(t) is the function X(s) defined by 


X(s) = i. x(t)e” “dt, (3.1) 


provided the improper integral exists, meaning 


b 


lim a(t)e “dt exists. 
boo Jo 


The integrand in (3.1) is a function of t and s, and we integrate on t, evaluating 
at t = Oandt = +o. This leaves a function of s. Often we represent the Laplace 
transform in function notation, 


Lix(t)](s) = X(s) orjust Lia] = X(s). 


£ represents a function-like operation, called an operator or transform, whose 
domain and range are sets of functions; £ takes a function x(t) and transforms 
it into a new function X(s) (see Figure 3.1). In the context of Laplace trans- 
formations, t and x are called the time domain variables, and s and X are 
called the transform domain variables. In some applications, s may be com- 
plex variable having the form s = 0+i7. Typically, we use lower case letters for 
time domain functions and upper case letters for transform domain functions. 
An important observation is the linearity of the transform. 


Theorem 3.2 


(Linearity) The Laplace transform is a linear operation; that is, the Laplace 
transform of a sum of two functions is the sum of the Laplace transforms of 
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Laplace 
Transform 


xX 
transform / \ 


domain 


time 
domain 


Figure 3.1 The Laplace transform £ as a machine that transforms functions 
x(t) in the time domain to functions X(s) in the transform domain. 


each, and the Laplace transform of a constant times a function is the constant 
times the transform of the function. We can express these rules in symbols by 


Llax + By] = alla] + BLIy], (3.2) 


where x = x(t) and y = y(t) are functions and a and @ are any constants. 
Observe that (3.2) is the same as 
Co Co [oe) 
| (ax(t) + By(t))e dt = af a(t)e *dt + +6 f y(t)e” *dt, 
0 0 0 
which is just a statement of the properties of an integral. 


We can compute the Laplace transform of many common functions directly 
from equation (3.1). 


Example 3.3 


Let x(t) = e®. Then 


b 
X(s) = lim ee dt = Ting el 8)" de 


b- co 0 b—0o 0 


140 3. Laplace Transforms 


or, in different notation, 


1 


’ 
s—a 


ie = 


s>a. 


Notice that there is a restriction on the transform variable s, which is common. 
We often make the preceding calculation more concise by only writing 


x(s)= | ettetat = | elas) gy 
0 0 


Example 3.4 
Let x(t) = 1. Then 


1 = i 
X(s)= line “Qh ES ae, St, 
0 —s Os 


In different notation, £[1] = 1/s. This transform exists only for s > 0; otherwise 
the improper integral does not converge. 


Example 3.5 
Let x(t) =t. Then, using integration by parts (u =t, du = e~*'dt), 


“a —st er —_— 1 “ —st 1 
X(s) = te “dt = |t 5 l-e dt = 3, s>0. 
0 —$§ Jt=0 0 


You may have concluded that calculating Laplace transforms can be tedious 
business. Fortunately, generations of mathematicians, scientists, and engineers 
have computed the Laplace transforms of many, many functions, and the results 
have been catalogued in tables and in software systems. Some of the tables are 
extensive. In this chapter we require only a short table, which is given at the 
end of the chapter. The table lists functions x(t) in the first column, and their 
transforms X(s), or £[z], in the second. The strategy in this text is to make 
liberal use of the table and not delve into detailed calculations of transforms. 


The Inverse Transform 


Given x(t), the Laplace transform X(s) is computed from the definition 
given in formula (3.1). This suggests the opposite problem: given X(s), find 
a function x(t) whose Laplace transform is X(s). This is the inverse problem. 


3.1 Definition and Basic Properties 141 


Unfortunately, there is no elementary formula® that gives x(t) in terms of X(s). 
In general, we use the notation 


ai) =" |(X(s)\y. of = 2°? x]: 


We call £7! as the inverse transform. The functions x(t) and X(s) form a 
transform pair, and they are listed together in two columns of the table; the 
left column is the inverse transform of the corresponding element in the right 
column. 

The inverse Laplace transform is a linear operation as well: 


L~* [aX (s) + BY (s)] = aL ~*[X(s)] + BL" [Y(s)]. (3.3) 


Example 3.6 


If X(s) = 1/(s — a), then Example 3.3 shows x(t) = e*. Therefore, x(t) = e* 
is the inverse transform of X(s) = 1/(s — a), and we write 


ett — fo} 1 
s—al- 


Similarly, from Example 3.4 


and from Example 3.5 


<q, fa 
L 5] =" 


As we observed, the Laplace transform is an improper integral. You may ask 
which functions have Laplace transforms. Clearly, if a function f(t) grows too 
quickly as t gets large, then the improper integral will not exist and there will 
be no transform. There are two conditions that guarantee existence, and these 
are reasonable conditions for most problems in science and engineering. First, 
we require that f(t) not grow too fast; a way of stating this mathematically is 
to require that there are constants M > 0 and r for which 


If] < Me” 


is valid for all t > to, where to is some value of time. That is, beyond the value 
to the function is bounded above and below by an exponential function. Such 


° The formula for the inverse transform is a contour integral in the complex plane, 
and is beyond the scope of this text. See Churchill (1958), for example, for a 
readable treatment. 
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functions f are said to be of exponential order. Second, we require that f(t) 
be piecewise continuous (PWC) on 0 < ft < oo. In other words, on any 
bounded subinterval of 0 < t < co we assume that f(t) has at most a finite 
number of simple discontinuities, and at any point of discontinuity f(t) has 
finite left and right limits. One can prove that if f(t) is piecewise continuous 
on 0 < t < co and of exponential order, then the Laplace transform F'(s) exists 
for all s > r. Even more can be stated. If f(t) is PWC and exponential order, 
then 


Kk 
F(s)<—, K>0, 
Ss 


and lims_,. F(s) = 0. If the limit of a function G(s) does not go to zero as 
s — oo, then G(s) cannot be a Laplace transform of some function g(t). 


Example 3.7 


(Unit switching function) As mentioned earlier, discontinuous functions are 
common forcing functions in physical systems. Now we introduce a simple, unit 
step function that greatly aids the representation of such functions. We define 
the Heaviside function H(t) by’ 


0, t<0; 
1, t>0. 


H(t) = { 


Its translation by a units to the right is H(t — a), or 


0, t<a 
1, t>a. 


PI 


H(t-a)={ 


This function is like a switch which is off (zero) if t < a, and on (1) when 
t >a. In an circuit, for example, this would mean the switch is open for t <a 
and closed for t > a. The Laplace transform of H(t — a) is easily calculated by 
breaking up the integral into two pieces, t << aandt>a: 


LIH(t —a)] = [ H(t —a)(t)e~*dt 


2 [ H(t — a)e~*tdt + i’ H(t —a)(t)e~“tat 


=i o-ewar+ | 1-e dt 
0 a 


” The Heaviside function is commonly denoted by H and is the only function we use 
that breaks the rule of using lower case letters for time domain functions. 
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Therefore, 
1 
LIH(t-—a)]=-e*%, s>0. 
S 
This transform automatically yields the inverse transform 


H(t-a)=CL (Ze a); 


The Heaviside function is also useful for expressing multi-lined functions in 
a single formula. 


Example 3.8 
Consider the step function 
3, O<t<2 
ae oo eae 
A 2, 3<t<6 
0, +t>6. 


This can be written in one line as 
f(t) =3H(t) + (4-3) A(t — 2)(t) + (2 — 4) A(t — 3)(t) + (0 — 2) H(t — 6)(t). 


The first term switches on the function 3 at t = 0; the second term switches off 
3 and switches on 4 at time t = 2; the third term switches off 4 and switches 
on 2 at ¢ = 3; finally, the last term switches off 2 at t = 6. Using the linearity 
of the Laplace transform we have 

3 i 295 2 es 


F(s) = L[f(t)] Sete ee Ee 


Two additional operational formulas are extremely useful for solving differ- 
ential equations. 


(a) (Shift Property) The Laplace transform of a function times an exponen- 
tial, f(t)e%, is given by, 


Lif (e"] = F(s — a). (3.4) 


Multiplying a function f(t) by an exponential has the effect of shifting the 
transform F'(s) of f(t) to F(s — a). 
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(b) (Switching Property) The Laplace transform of a function f(t) that 
switches on at t =a is given by 


LIA (t — a)f(t — a)] =e“ F(s). (3.5) 
This result is often used in its inverse form: 
L*[e- F(s)] = H(t — a) f(t— a). 


Proofs of the properties (a) and (b) follow directly from the definition of the 
Laplace transform, and they are requested in the exercises. 


Example 3.9 
Find the Laplace transform of the function 
foSste 
We know that the transform of f(t) =t is F(s) = 1/s?. By the shift property, 


Lite = F(s- (-2)) = 


(s+ 2)?" 


Example 3.10 


Find the inverse transform of the function 
1 
F(a) =e ™. 
(s) 8— 3° 
The exponential on the right signals the switching property. We know from the 
table that 


By the switching property, 


Lo | 1 aa 23 H(t — 3)e2 3). 
eras 


The exercises contain many examples of illustrating the preceding concepts 
and extending the Laplace transformation to additional functions. 


EXERCISES 


1. Use the definition of the Laplace transform to compute the transform of 
the square pulse function z(t) = 1, 1 < t < 2; x(t) = 0, otherwise. Plot 
x(t) on t > 0, and plot its transform X(s). 


3.1 
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. Use the definition of the Laplace transform to find the transform of x(t) = 


e ** H(t — 2). 


. Find the Laplace transform of x(t) = sinkt and x(t) = coskt using the 


definitions 


sin kt = ~ (e"** —e***) | coskt = 5 (ei*t 4 et) 


Check your answers in the table. 


. Find the Laplace transform of the hyperbolic functions x(t) = sinh kt and 


x(t) = cosh kt using the definitions 


sinh kt = . (ce —e-**), cosh kt = = (e* + e7*). 


1 
2 


Check your answers in the table. 


. Derive the operational formulas (3.4) and (3.5) directly from the definition. 


Hint: Change variables in the integrals. 


. Use the definition of Laplace transform to show that 


LIfHAt—a)| =e WL[f(t + a)]. 


. Use the preceding exercise to compute L[t? H(t — 1)]. 


. Find the Laplace transform of the following functions. 


a) 6+ 5e~7 + te. d) sin(2t+ 7). 
b) tH(t — 3). e) 3e~ cosht. 
c) cos 5t. f) H(t— 7) cos(t — 7). 


. Find the inverse transform of the following functions. 


a) sp f) Be 
b) 3_ 3. g) aT 
c) Gos h) e778 5 
a) Fe ) en 
e) see es 
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10. 


11. 
12. 


13. 


14. 


15. 


16. 


17. 


18. 
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Sketch the graphs of sint, sin(t — 7/2), and H(t — 7/2) sin(t — 7/2), and 
find the Laplace transform of each. 


Use the shift property to find the Laplace transform of e“ sin kt. 


Use the switching property to find the Laplace transform of 


0 t<2 
v(t) = { e', t>2. 


Show that 
8 


Lf (at)] = =F ( ie a> 0. 


a 


(a) Does the function x(t) = e’ have a Laplace transform? (b) What 
about x(t) = 1/t? Explain why or why not. (c) State why X(s) = +e 
cannot be the Laplace transform of some function x = x(t). 


Plot the square-wave function 


Co 


ft) = UCI)" a(t— n) 


n=0 


on the interval ¢ > 0 and find its transform F'(s). Hint: Use the geometric 
series 1+ 2+ 22+---=1/(1— 2) to find the sum. 


From the definition of the Laplace transform, find £ [1 / vt] using the inte- 
gral substitution st =r? and using [5° exp(—r?)dr = /7/2. 


The Gamma function is a special function defined by 


co 
T(y) =| e tw ld, y> tl. 
0 
It is important in probability, statistics, and many other areas of mathe- 
matics, science, and engineering. 


a) Show that [(n+1) = nI'(n) and I'(n+1) = n! for nonnegative integers 
n. Hint: Integrate by parts. 


b) Show that [($) = /7. 
c) Show that 


Prove that the inverse transform is a linear operation, that is, it satisfies 
(3.3). 
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3.2 Differential Equations 


We derived some of the basic properties of Laplace transforms, and now we 
are prepared to take up the key issue of this chapter, that is, solving differ- 
ential equations. What makes the Laplace transform so useful for differential 
equations is this: 


The Laplace transform turns derivative operations in the time 
domain into multiplication operations in the transform domain. 


We calculate the transforms of derivatives using the basic integration by parts 


formula: ; 


b 
/ vty (at = a(dy(ole — f a'(t)y(t)dt. 


a 
In elementary courses integration by parts is a technique used to calculate 
integrals, but it is an essential theoretical tool used in differential equations. 
We think of the formula as a way of removing the derivative on one factor in 
an integrand and putting it on the other factor, while generating a boundary 
term. The following theorem gives the fundamental operational formulas for 
solving differential equations. 


Theorem 3.11 


Let x(t) be a function and X(s) its Laplace transform. Then 


We prove (3.6). Using integration by parts, 


Lie’) = ; n (teat = [2(t)e“*] =" — i ~ sx(t)e~“*tdt 
0 0 
=—2z(0)+sX(s), s>0. 
The second operational formula (3.7) can be derived using two successive inte- 
grations by parts, and we leave that calculation as an exercise. A simpler argu- 
ment is to obtain (3.7) using (3.6). Simply, 
La") = £{(2")’] 
= sL{x'] — x'(0) 
= s(sX(s) — 2(0)) — 2'(0). 


There are similar formulas for transforms of higher derivatives. See Table 3.1. 
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Example 3.12 


As the previous calculation illustrates and suggests, the derivative formulas 
(3.6)-(3.7) are useful to find transforms without resorting to the integral def- 
inition of the Laplace transform. For example, we calculate L[t?]. First notice 
that (t?)’ = 2t. Then, we have 


cl(t2)'] = sL{f2] — 0? = L[2t] = =. 


Therefore, 
2 
Lit?] = =. 
’1=2 
We can continue this process to compute the transforms of f?, t+, t°,.... By 
induction it follows that 
n! 
ny) _ — 
Lit") = Sar m= 0, Ty 23 ate 


Example 3.13 


Here is an example using the second derivative formula (3.7). We find £[cosh t] 
by writing 

L{cosh t] = L[(cosht)”] = s*£[cosh t] — s cosh 0 — sinh 0 
s’L[cosht] — s. 


Solving for £[cosh t] gives us the transform 


s 
s?—1 


L{cosh t] = 


3.2.1 Initial Value Problems 


The derivative formulas (3.6)—(3.7) allow us to transform a differential equation 
with unknown z(t) into an algebraic problem with unknown X(s). We solve 
for X(s) and then find x(t) using the inverse transform « = £7! [X]. 

The following examples illustrate how this procedure works to solve ini- 
tial value problems for linear differential equations with constant coefficients. 
Actually, it is applicable on equations of all orders and on systems of several 
equations in several unknowns. We assume x(t) is the unknown state function. 
The idea is to take the transform of each term in the equation, using the linear- 
ity property. Then, using Theorem 3.11, reduce all of the derivative terms to 
algebraic expressions and solve for the transformed state function X (s). Finally, 
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Algebraic 
ODE equation 
in x (0) L in X(s) 
solve 
v -1 
L 
x (A) Xs) 


Figure 3.2 An ODE for an unknown function x(t) is transformed to an 
algebraic equation for its transform X(s). The algebraic problem is solved for 
X(s) in the transform domain, and the solution is returned to the original time 
domain via the inverse transform. 


invert X(s) to recover the solution x(t). Figure 3.2 illustrates this three-step 
method. The last step in this procedure, finding the inverse transform, is the 
most difficult, and in this section we get additional practice in finding inverse 
transforms. 


Example 3.14 
Consider the second-order initial value problem 
a” +k’x=0, 2(0)=0, 2'(0)=1. 
Taking transforms of both sides and using the linearity property gives 
Li[x”| + k° Lz] = LO). 
Then Theorem 3.11 gives 
s?X(s) — sx(0) — 2’ (0) + k?X(s) = 0, 


which is an algebraic equation for the transformed state X(s). Using the initial 
conditions, we get 

s’?X(s) —1+k?X(s) =0. 
Note that the initial conditions are actually part of the transform formula. 
Solving for the transform function X(s) gives 


_ 1 1 ok 

~ R452 kh 52 +k?’ 

which is the solution in the transform domain. Therefore, from the table, the 
inverse transform is 


X(s) 


1 
x(t) = k sin kt, 


which is the solution to the initial value problem. 
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Example 3.15 
Solve the first-order nonhomogeneous equation 
a +2r=e', 2x(0)=0. 
Taking Laplace transforms of each term 
Lix'| + £L[22] = Lle~ 4], 


or ‘ 
s+l1 

Use the initial condition to set (0) = 0 and then solve for the transformed 
function X(s) to get 


sX(s) — x(0) +2X(s) = 


1 
eae CEPI CSES) 


Now we can look up the inverse transform in the table. We find 


oi 1 
Fe DEED) 


x(t) =L 


Joete 


Sometimes a table of transforms may not include the exact entry for an 
inverse transform and we have to algebraically manipulate or simplify it to 
obtain a table entry. A common technique is to expand complex fractions 
into their partial fraction decomposition, a technique encountered in elementary 
algebra and in calculus. We observe, however, that there are extensive tables 
and computer algebra systems containing large numbers of inverse transforms. 
Thus, the partial fractions technique for inversion is not used as often as in the 
past, and we illustrate only a few simple examples of the technique. 


Example 3.16 
(Partial Fractions, I) In the last example we obtained 
1 
X(s) = —————.. 
= GeDerD 
We can decompose X(s) as 
1 a b 


(s+1)(s+2) (s+1)  (s+2)’ 
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for some constants a and b to be determined. Combining terms on the right 
side gives 


1 _ a(s + 2) +b(s +1) 
(s+1)(s+2) = (s +1)(s +2) 
(a+ b)s+2a+b 


~ “(s+ 1)(s+2) 
Comparing numerators on the left and right force a+b = 0 and 2a+b= 1. 
Hence a = —b = 1 and we have 


1 1 —1 


AO Gant) Gal? Exo. 


We reduced the complex fraction to the sum of two easily identifiable frac- 
tions that are found in the table. Using the linearity property of the inverse 
transform, 


Example 3.17 


(Partial Fractions, II) A common expression encountered in solving differ- 
ential equations is i 

aE) s?+bs+eo 
If the denominator has two distinct real roots, then it factors and we can 
proceed as in the previous example. If the denominator has complex roots, 
then we complete the square of the denominator. For example, consider 


1 
X(s) = —=————.. 
Taegan 
Then, completing the square in the denominator, 
1 
a aa Rey ET ee aa 
s°+3s+(5) — (3) +6 


il 
(0+ 9) + (4B) 


This entry is in the table, up to a factor of V15/2. Therefore we multiply and 
divide by this factor and locate the inverse transform in the table as 


x(t) = 2 _6-3¢/2 sin nee 
V15 2 
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Piecewise continuous sources 


Laplace transform methods are applicable on problems of the form 


x’ +be’+cxr= f(t), t>0 
2(0) =ao< ¢ (0) ei: 


If the forcing function f is a continuous function, then we can use the method 
of variation of parameters to find the particular solution; if f has the special 
form of a polynomial, exponential, sine, or cosine, or sums and products of these 
forms, we can use the method of undetermined coefficients to find the particular 
solution. If, however, f is a piecewise continuous source with different forms 
on different intervals, then finding the general solution would be difficult. On 
each subinterval interval we would have to find the general solution and then 
determine the arbitrary constants by matching up solutions at the endpoints 
of the adjacent subintervals. This is an algebraically difficult and tedious task. 
Using Laplace transforms, however, is not so tedious. Now we present additional 
examples on how to deal with discontinuous forcing functions. 


Example 3.18 


As noted earlier, the Heaviside function is used to express piecewise, or multi- 
lined, functions in a single line. For example, 


t, O<t<l 
f@) = 2, 1<t<3 
0, t>3 
= t+(2-—t)H(t—1)-2H(t—3). 


The first term switches on the function t at t = 0; the second term switches 
on the function 2 and switches off the function t at t = 1; and the last term 
switches off the function 2 at t = 3. By linearity, the Laplace transform of f(¢) 
is given by 


F(s) = £L{t] + 22(A(t — 1)] — Lit (t — 1)] — 2L[ A(t — 3)]. 
The first, second, and fourth terms are straightforward: 


Cif] =1/s?, LIN (-1)) = =e"*, C[Ht(t—3)] =e 


8 
The third term can be calculated using CL [f(t)H(t — a)] = e~“*L[f(t+a)]. See 
the table. With f(t) = t we have 


1 1 
LItH(t —1)] =e °Lit+ 1) = pe + ae 
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Putting all these results together gives 


1 2 wg 1 —s i re 2 3s 
F(s)= 3+ - (46 eae )-26 e 


Example 3.19 


Solve the initial value problem 
xv’ +42 =sint— H(t—7)sint, 2x(0)=2'(0) =0. 


Physically, this equation models an oscillator where the forcing term is one 
hump of the sine curve on 0 < t < a, which then switches off. The Laplace 
transform of of the equation gives 


s’X(s)+4X(s) = Lisint — H(t—7)sin¢| 
1 ae at 


“yr ET 


To get the second term on the right we used the table entry £[H(t — a) f(t)] = 
e “Lif (t+ a] with f(t) = sint. Thus, 


L[H(t — 7) sint] = e~**L{sin(t + 7)| 


=e “L/sint cos zm + sin 7 cost] 


~™f[-sint] 
= —7s 1 
an ge +1 
Therefore, 
1 1 


1 Gane Cane 


Now we face inversion. Using partial fractions we get 


1 __A “ B = AtBe + tAte 
(s?+1)(s2+4)  s2+1 58244 (52 +1)(s?+4) 
Thus 4+ B=0 and 4A+4+ B=1, giving A= 3, B= 3. Hence, 
1/3 


X(s) = 


a: ene 1/3 
set+1l 8244 set+1 s244)° 


pa 1/3 1/3 


set+1 s52+4 


Clearly 


: t : 2t. 
= 3 sin 6 sin 
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We use the switching property to invert the exponential term. We have 

cf a = * H(t — 1m) sin(t — 7) — * H(t —7m)sin2(t — 7). 
(s? + 1)(s? + 4) 3 6 

Finally, the solution is therefore 


1 1 1 1 
x(t) = 3 sint — S sin 2t + gilt — 1) sin(t—1)t— guilt —)sin2(t—7)t. (3.8) 


A plot of the solution is shown in Figure 3.3. 


Figure 3.3 The solution (3.8). 


Remark 3.20 


(Piecewise continuous inputs) When the input of a differential equation is 
only piecewise continuous (PWC), it is not obvious what properties the solution 
possesses. Consider the differential equation 


ax” + ba’ + cx = f(t) 


where f is PWC for t > 0. Is x(t) continuous? Differentiable? The answer is 
that it is continuous. Consider for example the problem 


2” = H(t—3), x(0) =2'(0) =0. 


Here, f(t) = H(t— 3) is discontinuous. The integral, or antiderivative, of a dis- 
continuous function is continuous. Here, w’(t) = { H(t—3)dt = (t—3)H(t—3), 
which confirms this; integration is a smoothing process. Clearly, x(t) has a 
discontinuity in the derivative. Integrating again, we get x(t) = {(t — 3)H 
(t — 3)dt = 4$(t — 2)3H(t — 3). This is the solution of the equation and it is in 
fact differentiable. 
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Example 3.21 


In this example we calculate the response of an RC circuit when the emf is a 
discontinuous function. These types of problems occur frequently in engineer- 
ing, especially electrical engineering, where discontinuous inputs to circuits are 
commonplace. Therefore, consider an RC circuit containing a 1 volt battery, 
and with zero initial charge on the capacitor. Take R= 1 and C= 3. Assume 
the switch is turned on from 1 < t < 2, and is otherwise switched off, giving 
a square pulse. Using g = q(t) for the unknown charge on the capacitor, the 
governing is 
qd +3q=H(t-—1)—H(t-2), (0) =0. 


We apply the basic technique with the notation Q(s) = L[q(t)]. Taking the 
Laplace transform gives 


sQ(s) — 4(0) + 3Q(s) = <(-* — €-™. 


Solving for Q(s) yields 


1 —s —2s 
Q(s) = an “e) 
_ 1 -—s 1 —2s 
~ 5(6+3)_ ~ s(6+3)- 


Now we have to invert, which is always the hardest part. Each term on the right 
has the form F'(s)e~“*, and therefore we can apply the switching property. From 
the table, or by partial fractions, we have 


Therefore, by the switching property, 


-1 i —s| _ i —3(t-1 


Similarly, 


-1 i —2s| __ if —3(t-—2 
£ = |= 30-6 a2) GG = 2); 


These two results give the charge on the capacitor as 


= s(l — e-8t-D) A(t — 1) — (1 — e Mt-2)) A(t — 2), 


See Figure 3.4. 
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0.1 


> 


1 2 3 t 


Figure 3.4 The switch is open up to time t = 1, so the charge response is 
zero. When the switch is closed at t = 1 the charge increases until t = 2, when 
the switch is again opened. The charge then decays to zero. 


EXERCISES 


1. Find a, b, and c for which 
1 as+b Cc 


s?(s—1) 8? s—1 


Then find the inverse Laplace transform of 


1 
s?(s—1) 
2. Find the Laplace transform: 
a) H(t — 7) cost. e) e % sin 3t 
b) 3r4. f) elatbi)t 
c) ¢t?sint. g) e% + (3 — e?t) H(t — 1). 
d) fj rcostdr. h) (1—2)H(t— 3). 


3. Find the inverse transform of the following functions. 


a) rprece: ©) Goa 
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e) GH. i) e~5* sin 2(¢ — 3). 
f) ser 1) 6 eee 

8) Ta k) Ee 

h) Go3)2F4 1) Sot 


4, Write f(t) = (t— 1)H(t — 1) — 2H(t — 3) + e~*/?H(t — 4) as a multi-line 
formula and plot f(t) on [0, 00). 


5. Plot the function 


x(t) = 


and find the Laplace tranform X(s). 
6. Solve the following initial value problems using Laplace transforms. 


a) a’ +52 = H(t—2), 2(0)=1. 


) 
) a +x=sin2t, 2x(0)=0. 

) a” —a'-6r=0, 2x(0) =2, 2/(0)=-1 

d) x” —22/+2¢=0, 2(0) =0, 2/(0) =1. 

e) 2 —2e'+2a=e-%, x(0)=0, x(0) =1. 

) a” —a' =0, 2(0)=1, 2/(0) =0. 

ie +0.40' +22 =1-H(t—5), 2x(0) =0, 2/(0) =0. 
) 2” + 9a =sin3t, (0) =0, «/(0) =0. 

i) e& —22=1, 2(0)=1, x'(0) =0. 

j) e =2n+H(t-1), 2(0)=0. 


h 


ae 


1 


7. Sketch the function f(t) = 2H(t — 3) — 2H(t — 4) and find its Laplace 
transform. 

8. Find the Laplace transform of f(t) = t? H(t — 3). 

9. Invert F(s) = Gar: 

10. Find the inverse transform of 
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11. 


12. 


13. 


14. 
15. 


16. 


17. 
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Solve the initial value problem 


Hite cos2t, O<t< 2m, 
a 0, t > 27, 


where x(0) = 2’(0) = 0. Sketch the solution. 
Consider the initial value problem xv’ = x + f(t), x(0) = 1, where f(t) is 
given by 
0, O<t<l 
se) = { -2, t>1. 


Solve this problem in two ways: (a) by solving the problem on two intervals 
and pasting together the solutions in a continuous way, and (b) by Laplace 
transforms. 


An LC circuit with LZ = C = 1 is ramped-up with an applied voltage 


b- Daeeeo 


ao={ ¢ t>9. 


Initially there is no charge on the capacitor and no current. Find and sketch 
a graph of the voltage response on the capacitor. 


Solve a! = —x+ H(t — 1) — H(t — 2), x(0) =1. 


Solve the initial value problem 


ee n?, O<t<1, 
~ | 0, t>1, 


where x(0) = 1 and 2’(0) = 0. 
Let f(t) be a periodic function with period p. That is, f(t + p) = f(t) for 
all t > 0. Show that the Laplace transform of f is given by 


P 
F(s)= —=/ f(rje-"*dr. 


Hint: Break up the interval [0,-+co) into subintervals (np, (n + 1)p), cal- 
culate the transform on each subinterval; finally use the geometric series 
ltz2t+2%7+234---=1/(1—2z). 


Show that the Laplace transform of the periodic, square-wave function that 
takes the value 1 on intervals [0, a), [2a,3a), [4a,5a),..., and the value —1 
on the intervals [a, 2a), [3a, 4a), [5a,6a),..., is 


eee (=) : 
s 2 


3.2 


18. 


19. 


20. 


ls. 
22. 


23. 


24. 


25. 
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Write a single-line formula for the function that is 2 between 2n and 2n+1, 
and 1 between 2n — 1 and 2n, where n = 0, 1, 2, 3.... 


| [rover = = 


Hint: Take the transform of the time derivative of the integral. 


Show that 


Derive the formulas 
Litf®)=—-F(s), LF (s)] =—-tf(t). 
Hint: Calculate the derivative of F'(s). 


Use the preceding exercise to find the inverse transform of arctan (4) ‘ 


Show that 
Lie" f(t)] = (-1)"F™ (s), n =1, 2, 3,.... 
Show that oo 
L 4 =] F(r)dr, 
and use the result to find 
sinht 
£ | | 


The Laplace transform applies to two (or more) simultaneous first-order 
differential equations with constant coefficients, for example, 


xv =x—2y 


y =3e+y, 


with initial conditions (0) = 1, y(0) = 0. Here, « = x(t) and y = y(t) are 
the two unknowns. Letting £[a] = X(s) and L[y] = Y(s), solve the initial 
value problem for this pair of DEs. 


Use Laplace transforms to solve the two simultaneous differential equations 
av =2Qe-y 
y =o, 


with «(0) =a, y(0) =0. 


160 3. Laplace Transforms 


3.3 The Convolution Property 


The additivity property of Laplace transforms was stated earlier: the Laplace 
transform of a sum is the sum of the transforms. But what can we say about 
the Laplace transform of a product of two functions? Stated more precisely, if 
x = x(t) and y = y(t) with Lia] = X(s) and Liy] = Y(s), then what is L[ry]? 
It is not equal to X(s)Y(s). Then what is true? We ask it this way. What 
function has transform X(s)Y(s), or differently, what is the inverse transform 
of X(s)Y(s)? The answer may be a surprise because it is nothing one would 
easily guess. The function whose transform is X(s)Y(s) is the convolution of 
the two functions x(t) and y(t). This is defined as follows. If x(t) and y(t) are 
two functions defined on [0, co), the convolution of x and y, denoted by xx y, 
is the function defined by 


(xx y)(t) = i x(r)y(t — T)dr. 


Sometimes it is convenient to write the convolution as x(t) « y(t). The convo- 
lution property of Laplace transforms states that 


Lia *« y] = X(s)Y(s). 
In terms of the inverse transform, 
L~"[X(s)¥(s)] = (a *y)(t). 


This property is very useful because when solving a DE we often end up with 
a product of transforms; we may use this last expression to invert the product. 


Example 3.22 


Find the convolution of 1 and t?. We have 


t t 
ime | Leta rPdr= f (P20 + 7? )dr 
0 0 


Notice also that the convolution of ¢? and 1 is 
3 


t 
t 

Pers f Pad =F. 
0 3 
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Remark 3.23 


It can be shown (see the Exercises) in general that 


(x * y)(t) = (y*a)(), 


and therefore the operation of convolution is commutative. This means that the 
integrand in the convolution can be arranged so that the choice of the shifted 
function makes the integration easier. In the last example, note that the second 
choice, where the function 1 is shifted, is a simpler calculation. 


Verification of the convolution property is straightforward using the multi- 
variable calculus technique of interchanging the order of integration. The reader 
should verify each of the following steps. 


L ( | Fane = rar) = | 7 ( | ore e rar) edt 


This last expression is X(s)Y(s). 
In the exercises you are asked to show that x * y = y* x, so the order of the 


two functions under convolution does not matter. 


Example 3.24 


Find the inverse of 
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We can do this by partial fractions, but here we use convolution. We have 


era] - "Goal 


t 
=1xsin3t= | sin 3rdtr 
0 


1 
=5 (1 — cos 3t). 


Example 3.25 


Solve the nonhomogeneous DE 
gg + ka = f(t), 


where f is any given input function, and where x(0) and 2’(0) are specified 
initial conditions. Taking the Laplace transform, 


s’X(s) — sx(0) — 2’ (0) +k? X(s) = F(s). 

Then ; F(s) 

8 j s 
Pe eae 8? 4+ 2° 


Now we can invert each term, using the table to calculate the inverse of the first 


X(s) = x(0) 


two terms, and using convolution on the last term, to get the solution formula 


x(t) = «(0) cos kt + ro) 


t 
sin kt + | f(r) sin k(t — r)dr. 
0 


Use of the convolution is a convenient way to find the solution to a differential 


equation with arbitrary source term. 


EXERCISES 


1. Compute the following convolutions: 


a) sint * cost. Cy Eee: 


bye we a): tee 


2. Give a specific example to show that, in general, L[x(t)y(t)] 4 X(s)Y(s). 
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. (a) Using Laplace transforms and the convolution property, find the general 
solution of the initial value problem 


xv’ —ax= f(t), x2(0) = 29 


using Laplace transforms. (b) Solve the equation using integrating factors, 
and compare with part (a). 


. Find the Laplace transform of the following integrals. 


a) f(t) = if, e*(t — s) ds. b) f(t) = as e—-®) sin s ds. 


. Use a change of variables in the convolution integral to show that the order 
of the functions used in convolution integral does not matter. That is, 


(x * y)(t) = (y* x)(t). 
. Solve the initial value problem 


x" —w's = f(t), 2(0) =2'(0) =0. 


. Solve the initial value problem 


xv” —4r=1-—H(t-1), x(0) =2'(0) =0. 


. Express the solution of the IVP as a convolution integral: 


g+3a'+2r=—e*, 2x(0)=2'(0) =0. 


. Express the solution of the IVP as a convolution integral: 


ve! +2a'+2x2=sinwt, 2«x(0) =2'(0)=0. 


. Write an integral expression for the inverse transform of X(s) = +e~**F(s), 
where £[f] = F. 


11. 


12. 


Find a formula for the solution to the initial value problem 


vc’ —a = f(t), 2x(0) =2'(0) =0. 


Use convolution to calculate 
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13. 


14. 


15. 


16. 


17. 
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Use convolution to calculate 
1 
Lot |——__} . 
fc a | 


(Integral Equations) An integral equation is an equation where the 
unknown function x(t) appears under an integral sign. In this exercise we 
consider integral equations having the form 


x(t) = f(t) +f k(t — r)a(r)dr, 


where f and k, called the kernel, are given functions. These types of equa- 
tions are called equations with a convolution kernel. Find a formula for the 
transform of the unknown, X(s), in terms of the transforms F and K of f 
and k, respectively. 


Using the method in the preceding exercise, solve the following integral 
equations. 


a) x(t) =t— fo (t—7)a(r)dr. c) a(t) = fo 2(r)dr + 7*. 
b) a(t) =144 fi a(r)dr. d) x(t) = —2 f} cos(t — r)a(r)dr. 


Solve the differential integral equation by Laplace transforms: 


x(t) -— a (¢—1)’a(r)dr =—-t, 2(0)=1. 


Solve the integral equation for x(t): 


_1 ft at), 
2) = ef Sar 


Hint: Use the Gamma function introduced in Section 3.1. 


3.4 Impulsive Sources 


Many physical and biological processes have source terms that act at a single 
instant of time. For example, we can idealize an injection of medicine (a “shot” ) 


into the blood stream as occurring at a single instant; a mechanical system, 
for example, a damped spring—mass system in a shock absorber on a car can 
be given an impulsive force by hitting a bump in the road; the switch in an 
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electrical circuit can be closed only for an instant, which leads to an impulsive, 
applied voltage. 

To fix the idea, let us consider a particle of mass m moving along a line 
for t > 0 and subject to a damping force equal to the velocity v and another 
applied force of magnitude f(t); assume the particle has no initial velocity. By 
Newton’s second law of motion, 


mv’ +v= f(t), v(0) =0. 


This is a first-order linear equation, and if the force f(t) is a continuous func- 
tion, or piecewise continuous function, the problem can be solved by the meth- 
ods presented in Chapter 2 (integrating factors) or by transform methods. We 
use the latter as illustration. Let V(s) = £[u(t)]. Taking Laplace transforms of 


the equation gives 

1/m 
= ——F 
oe s+1/m (s); 


where F'(s) is the transform of the applied force f(t). Using the convolution 
theorem, 


u(t) = a el F rdr. (3.9) 


We want to consider a special type of applied force f(t), one given by an 
impulse that acts only for a single instant of time (i.e., think of the mass hit 
by a swift blow of a hammer). To fix the idea, we start the clock at t = 0 
and the particle remains motionless until an impulse of 1 force unit is applied 
at the single instant of time t = a. We denote this unit impulsive force by 
f(t) = oa(t), which is called a unit impulse at t = a. The question is how 
to define it. Intuitively, it appears that we should take 6,(t) = 1 if t = a, and 
da(t) = 0, if t A a. But this cannot be correct. To illustrate, we substitute into 
(3.9) and obtain 


t 
FOr - | eI §, (7) dr. (3.10) 


If d(t) = 0 at all values of t, except t = a, the integral must be zero because 
the integrand is zero except at a single point. Therefore, the velocity is v(t) = 0 
for all t, which is incorrect. Something is wrong with this intuitive definition of 
the unit impulse d,(t). 

The problem is we have not yet to come to terms with the idea of an impulse, 
so let us take a different approach. Let p(t) = mv(t) be the momentum of the 
mass. In general, Newton’s law states that the time rate of change of momentum 
is the force, or 
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p=mv 
(a) 
1 


a-s2a ate a-eQaats2 


Bay: f 
(c) (d) 
1] —_—_ 1 
1 . 


a 


Figure 3.5 (a) The momentum changes from 0 to 1 over a small time interval 
(a —e€/2,a+e/2), and (b) the force causing this change; (c) the idealized case 
when the change in momentum occurs at a single instant of time t = a, and 
(d) the resulting impulsive force causing this change. 


In elementary physics, an impulse is defined as the change of momentum Ap 
that occurs when a force acts over a small instant of time At. Thus, the impulse 
is Ap = f(t)At. If the unit impulse is centered at t = a, and the force acts over 
a small time interval (a—¢/2,a+e/2), then we can imagine that the momentum 
changes from 0 to 1. This situation is depicted in the plot shown in Figure 3.5, 
panel (a). The resulting force, which is the derivative of momentum, has the 
shape shown in panel (b). However, we always have 


ate/2 
Ap = / f(t)dt = 1. 
a—e/2 

Notice that as € gets smaller and smaller, the last relation still holds true. 
Mathematically, we idealize this situation and assume the last relation holds 
true in the limit as e — 0. Thus, the momentum changes abruptly, as shown in 
Figure 3.5, panel (c). The corresponding derivative, or idealized applied force, 
is shown in 3.5, panel (d). The force just acts as a point source at t = a. But 
the change in momentum is still 1. 
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In summary, we regard a point source as a mathematical idealization. Let 
us take this idealization further and consider an applied unit force acting at 
t =a and given by 


1 E E 
A —~Ee¢et € 

om sr A-g< = at 5 
0, otherwise, 


2 [4 (+ (2-5) -#(- (2+ 9))]. 


where H is the Heaviside function. These idealized forces are rectangular inputs, 


l| 


ler — 


Ve! 


a-&2 a4 atée/2 


Figure 3.6 The idealized (rectangular) impulsive force fa,-(t) of height 1/e 
and width ¢. As e > 0, the function gets narrower and higher, but always has 
area 1. 


shown in Figure 3.6, that get taller and narrower (of height 1/e and width ¢) 
as € gets small, and for any ¢ we have 


ate/2 
/ Madra 


—e/2 


It seems reasonable therefore to define the unit impulse 6,(t) at t = a ina 
limiting sense, having the property 


at+e/2 
i da(t)dt =1, foralle >0. 
a—e/2 

Engineers and scientists used this condition, along with 6,(t) = 0, t 4 a, for 
decades to define a unit, point source at time t = a, called the delta function, 
and they developed a calculus that was successful in obtaining solutions to 
equations having point sources. But, actually, the unit impulsive force is not 
a function at all, and it was shown in the mid-twentieth century that the 
unit impulse belongs to a class of so-called generalized functions whose actions 
are not defined pointwise, but rather by how they act when integrated against 
other functions. Mathematically, the unit impulse 6,(¢) is defined by the sifting 
property 


[ da(t)b(t)dt = d(a). 
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That is, when integrated against a continuous function ¢(t), the delta function 
picks out the value of #(t) at t = a. On the other hand, over a variable interval 


we have : 
_ f 9, t<a, 
| Ja(t)o(t)dt i, { o(a), t > a, 


or, 
fl GGA Bead). 


We check that this works in our problem. If we use this sifting property 
back in (3.10), then for t > a the velocity is 


1 ft i 
v(t) = =f e &—7)/™5. (re) dr = H(t - ge ran 


which is the correct solution. That is, v(t) = 0 up until the time t = a, because 

there is no force. Furthermore, v(a) = 1/m. Therefore the velocity is zero up 
to time t = a, at which it jumps to the value 1/m, and then decays away. 

To deal with differential equations involving impulses we can use Laplace 
—st 


transforms in a formal way. Using the sifting property, with ¢(t) = e~*’, we 
obtain 


Lio) |= [ Ae “a= s, 


which is a formula for the Laplace transform of the unit impulse function. This 
gives, of course, the inverse formula 


Le ™*) S64 (2). 


If the impulse is given at t = a = 0, then 


L[5o(t)] = ee: 5y(t)eS*dt = 1. 


This gives the inverse formula 


The previous discussion is highly intuitive and lacks a careful mathemat- 
ical base. However, the ideas can be made precise and rigorous. We refer to 
advanced texts for a thorough treatment of generalized functions. Another com- 
mon notation for the unit impulse 6,(t) is 6(t—a). If an impulse has magnitude 
fo, instead of 1, then we denote it by foda(t). For example, an impulse given 
to a mass of magnitude 12 at time t =a is 12d,(t). 
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Next, we present another calculation of the Laplace transform of the unit 
impulse function. The idea is to compute the transform of the idealized impulse 
f-(t) (see Figure 3.6), and then take the limit as e > 0. We have 


eif-tt) = £ |= [# (t- (a-§)) -# (t- («+5))]] 


— 1 -(a-e/2)8 __ 1 -(ate/2)s 
ES ES 
_ 1 as Cae _ err) 
ES 
1 _,,2sinh $ 
= —eE —_—_— 
ES € 
_assinh(es/2) 
7 es/2 
Using I’Hospital’s rule to compute the limit, 
sinh 2 
ema) = lim cosh(es/2) = 1. 
e30 es/2 e>0 


Therefore we have 
lim £L[f-(t)] =e", 
e>0 


Example 3.26 
Solve the initial value problem 
wv’ +a" = d2(t), «x(0) =2'(0) =0, 
with a unit impulse applied at time t = 2. Taking the transform, 
s’X(s)+sX(s)=e **. 


Thus 


Using the table it is simple to find 
1 
CS | | Sil Se, 
s(s +1) 
Therefore, by the shift property, the solution is 


v(t) = £>* |] = Ge) 0-2), 
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Alternately, we can obtain x(t) using the convolution property and delta func- 


tions. We have 
1 —2s 


ca eer CN , 


and by convolution, 


a(t) = £7 | xi |e) 


ie 28) 

— fo — e~ (8-7) §5 (7) dt 
0 

= H(t—2) (1 = e-2)) 


The initial conditions are zero, and so the solution is zero up until time t = 2, 
when the impulse occurs. At that time the solution increases with limit 1 as 
t + oo. See Figure 3.7. 


Figure 3.7 Solution in Example 3.26: x(t) = H(t — 2) (1—e~-)). 


An Input-Output Approach 


Many problems occurring in electrical and chemical engineering, as well as in 
other areas, can be characterized as input-output systems. See Figure 3.8. These 
systems can be quite complicated with many components with many inputs and 
many outputs. For example, in an industrial chemical process the system could 
be a sequence of reactors, even with feedbacks among the components to control 
the various processes. 
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time domain transform domain 
i i SYSTEM 
input SYSTEM | output input : output 
Kt) k(t) x(t) F(s) (s) X(s) 


Figure 3.8 Input-output systems in the time domain and the transform 
domain. 


A linear nonhomogeneous differential equation 


ax” + be’ + cx = f(t), (3.11) 
x(0) = 2'(0) =0, (3.12) 


is the simplest example of an input-output system; f(t) is the input and the 
solution x(t), which is called the forced response, is the output. We have taken 
zero initial conditions, although it is not necessary. Of particular interest is 
understanding how such systems respond to special, representative inputs, or 
loads, such as an impulse, a step function, and a ramped load, shown in Fig- 
ure 3.9. Such systems can be studied in either the time domain, or the transform 
domain. 


to t tg t 1 t 
impulse step input ramp input 
Figure 3.9 Sample inputs: an impulse, 4,,(¢); a step function, H(t — to); 
ramped loading, t + (1 — t)H(t — 1). 


Let’s consider the input-output system defined in (3.11)—(3.12) and examine 
it in the transform domain. From our earlier treatment the forced response is 


where F'(s) = L[f(t)] and 


1 
as? +bs+c’ 


K(s) = 


(transfer function) 
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which is called the transfer function. Knowing the transfer function gives 
complete knowledge of the response of the system. It follows by the convolution 
property that 


w(t) = k(t) * f(t) = | k(t — 7) f(r) dr, 


which is the forced response. Note the similar but contrasting representations 
of the forced response in the time domain and the transform domain: 


u(t)=k(t)* f(t),  X(s) = K(s)F(s). 


Example 3.27 


(Impulse response) If f(t) = 6;,(¢), then in the transform domain the impulse 
response 
X(s)= K(sje"™. 


In the time domain, 


Example 3.28 
Find the impulse response: 
x” +22’ +52 =6;,(t), 2(0) = 2'(0) =0. 


The transfer function is 


K(s) = 1 _ Al 2 
1 + 2st5 2(s+12+4 
and therefore 1 9 

X(t) == mis 


———,— e 

2(s4+1)?4+4 

Taking inverse transforms and using convolution, 
a(t) = e* sin 2t * 6, (t) 


1 re 
5 | e~ 7) sin 2(t — 7)54, (7) dr 
0 


1 
= 5Ht- to)e~ '—*) sin 2(t — to). 


This impulse response is zero up to time t = to and then is a damped oscillation 
for t > to. See Figure 3.10 for to = 2. 
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Figure 3.10 Plot of the impulse response a(t) = 4H(t—2)e~*-) sin 2(t—2). 


EXERCISES 
1. Compute f>~ e~ 2(t-3)" §, (4) dt. 


2. Solve the initial value problem 


x’ + 3x = 06, (t) + H(t—4), 
x(0) =1. 
Sketch the solution. 


3. Solve the initial value problem 


Sketch the solution. 
4. Solve the initial value problem 
xv! +a = do(t), 
2(0) =a (0) = 0, 


Sketch the solution. 


5. Invert the transform F(s) = e~?%/s + e~*°. 


3. Laplace Transforms 


6. Solve the initial value problem 


10. 


11. 


ve +4x = 2(t) on 65(t), 
4(0):= 2 (0):= 0: 


. Solve the initial value problem 


vc! +2 = 3der(t), 
a(0)= 0; 2 (0). 1. 


. Consider a spring—mass setup with m = k = 1, where & is the spring 


constant. Initially the system is at rest, at equilibrium. At each of the times 
t = 0, 7, 27, 37,...,n7,... a unit impulse is given to the mass. Determine 
the resulting displacement x(t) of the mass. 


. Solve the problem 


2a" +a' +2x =65(t), x(0) = 2'(0) =0. 


(a) Identify the transfer function. (b) Find the impulse response in both 
the time and transform domain. (c) Plot the impulse response for 0 < t < 
20. 


Solve 
y"+y +y=4(t), y(0)=y'(0) =9, 
and plot the solution. 


A purely oscillatory system is ramped loaded at t = 5 with the input 


1 1 
f(t) = =(t -— 5) H(t — 5) 4 (1 a(t 5)) HeESAG), 
Find the response if the system is 
a" + 4x = f(t), x(0)=2'(0) =0, 


and plot the graph of x(t). 
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Table 3.1 Short Table of Laplace Transforms 
x(t) X(s) 


H(t —a) 
H(t—a)(t)f(t—a) 
f()H(t—a) 
sin kt 

cos kt 

sinh kt 

cosh kt 

e@ sin kt 

e cos kt 
tsin kt 

t cos kt 


(ew _ eb) 


i” f(t) 
Xo f(t — na) A(t — na) 


4 


Linear Systems 


The first three chapters dealt a single first-order or second-order linear differen- 
tial equation. A natural next step is to examine coupled systems of differential 
equations with several unknown functions. Many problems from the pure and 
applied sciences have multiple components linked together in some manner, 
and it is natural to formulate those as systems of equations. For example, an 
electrical circuit can have coupled loops, each with different circuit components, 
and each carrying a different current. Predator-prey models in ecology involve 
two animal species, the prey and predator, and their populations are coupled 
together through their interactions. Finally, two chemical reactors can be cou- 
pled by specifying flow rates from one into the other, and each can contain a 
different concentration of a chemical substance. 

In this text we consider only planar, or two-dimensional systems, consisting 
of two first-order equations in two unknown functions x(t) and y(t). As we 
will see, second-order equations, studied in Chapter 2, are equivalent to such a 
planar system, but a systems approach exposes an insightful geometrical struc- 
ture revealing the dynamics. Our goal is to show what to expect from a system, 
including general solutions and how to display them graphically for easy visu- 
alization. This is carried out by introducing matrix notation, a language that 
greatly simplifies their representation and which extends in a straightforward 
way to systems of higher dimensions. 
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4.1 Linear Systems vs. Second-Order Equations 


Consider the damped oscillator equation 
ma” +a’ + ka =0 


with unknown displacement x = x(t). If we introduce the velocity y = y(t) as 
another dependent function, then x’ = y and the damped oscillator equation 
becomes 

my’ +yy+kr =0, 


or, my’ = —ka — yy. Therefore, 


{ a= y, 
Ps Rigas ty! 
Qa aad 
This is a system of two first-order equations in two unknowns x = x(t) and 


y = y(t) and it is completely equivalent to the second-order damped oscillator 
equation. 


Remark 4.1 


We can always reduce a second-order linear equation 


ax” + ba’ + cx = 0 


to a first-order linear system by defining y = x’, as above. 


As well, first-order systems of equations occur naturally, as the next example 
shows. 


Example 4.2 


(Compartmental Model) Many linear systems come from compartmental 
models. These are models where there are several compartments with specified 
flow rates between them. For example, coupled chemical reactors, disease mod- 
els (those susceptible and those infected), physiological models (a chemical in 
the blood and in an organ), and so forth, are all compartmental models. In this 
example we consider a farm crop and the surrounding soil as two compartments. 
If a pesticide is sprayed on the soil at time t = 0, then the pesticide transfers 
to the plants through uptake in the root systems. Conversely, the plants trans- 
fer the pesticide back to the soil through respiration processes. Added to this 
constant exchange of chemicals between the two compartments, there is simul- 
taneously natural degradation of the pesticide in the soil. We visualize this 
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x 
crops i soil 
x ——— y 
ay 


[p 


Figure 4.1 A compartmental diagram showing the exchange rates of the 
herbicide between crops and the soil. The —yy term represents degradation, or 
decay, in the soil. 


processes by drawing a compartmental diagram as shown in Figure 4.1 indi- 
cating the flow rates between compartments. Let « = a(t) be the amount of 
pesticide (mass per volume) in the crop, and y = y(t) the amount in the soil. 
Further, let ay be the rate that the pesticide is taken up by the plants, and 6x 
the rate that it is transferred back to the soil; assume the pesticide in the soil 
degrades naturally with yy the degradation rate. Attending to the signs of the 
terms, have 


dx 


a Rate lost by the crop + Rate gained by the crop 


=-—Pr+ay, 
and 
dy : : : 
a Rate gained the soil+ Rate lost by the soil 
+ Rate of degradation = Bx — ay — yy. 


Therefore, we obtain a system of two equations with unknowns x(t) and y(t): 


dx 

ae —Bu + ay, 

d 

7 = Br —(at+7)y. 


We examine this model later in detail. 


Notation and Terminology 


A linear homogeneous system of differential equations with constant coefhi- 
cients has the form 


dx 
at ax + by, (4.1) 
dy =cax + dy, (4.2) 


dt 
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where a, b, c, and d are constants, and where x = x(t) and y = y(t) are 
the unknown states. For conciseness we often use x’ and y’ for derivatives. A 
solution consists of a pair of functions 


r=x(t), y=y(t), 


that, when substituted into the equations, reduces the equations to identities 
for all t. For planar systems of the form (4.1)-(4.2), solutions exist for all 
time —oo < t < oo. In applications we are generally interested in nonnegative 
times t > 0. There are infinitely many solutions to a linear system, and a single, 
unique solution is selected out if there are prescribed initial conditions, which 
take the form 


z(0) =a, y(0) =o, (xo, yo given). 


We visualize a solution in two ways. We can plot both x = x(t) and y = y(t) 
versus t on the same set of axes, as in Chapters 1 and 2; these are the time 
series, or component plots, and they tell us how the states x and y vary in 
time. Or, we think of x = x(t), y = y(t) as parametric equations of a curve 
in an xy plane, with time ¢ as the parameter along the curve; each value of t¢ 
corresponds to a point (a(t), y(¢)) in the plane which is traced out as t varies. 
Their direction as time increases is indicated by placing arrows on the curves. 
In the parametric context, a solution curve is called an orbit, and the xy plane 
is called the phase plane. Other words used to describe a solution curve or 
orbit are path, and trajectory. Figure 4.2 is an illustration of an orbit. 


Parametric plot 
of an orbit 
in phase space 


x() = (x(), YO) 


x) = &', yO) 


Figure 4.2 An orbit in the xzy-phase plane represented by a moving point or 
the position vector x(t) = x(t)i+y(t)j = (a(t), y(t)). Equivalently we represent 
the vector solution as a column vector. The vector x’(t) = a’(t)i+ y/(t)j = 
(a’(t), y/(t)) is the velocity vector and is tangent to the curve at the point 
(a(t), y(t)) at time t, and it indicates the direction the curve is traced out in 
time. 
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We recall from multivariable calculus that the orbit is the path traced out in 
time by a particle defined by the position vector x(t) = «(t)i+-y(t)j, where i and 
j are the unit vectors. The vector x’(t) = 2’ (t)i+y’(#)j is the velocity vector and 
it represents the tangent vector to the orbit at time t, and its magnitude is the 
particle’s speed. In differential equations we use a column vector representation 


of an orbit, 
-(8) 


x(t) is called the x-component and y(¢) is called the y-component of x(t). Its 
derivative vector, which gives components of the tangent vector, is then 


It is also common to write a vector as an ordered pair x(t) = (a(t), y(t)), which 
is an efficient notation for typed material. The velocity vector in this form 
is x(t) = (a(t), y/(t)). This ordered-pair notation, based on the equivalence 
between points and vectors, should cause no confusion even though points and 
vectors are technically different objects. 

We can take a geometrical approach to visualize the orbits of a system, 
similar to that in Chapter 1 where we visualized the solution curves of a single 
differential equation by plotting the slope field. For systems, at any point (2, y) 
in the zy phase plane, the right sides of (4.1)—(4.2) define the components of 
the tangent vector F, 


F(z, y) = (2’,y’) = (aw +b,cx+4+d), 


at that point. The orbit that goes through the point (x,y) must have tangent 
vector components (x’, y’). We can plot, or have software plot for us, this vector 
at several points (x,y) in the phase plane to obtain an overall pattern, or 
structure, of the orbits of the system. The set of all the tangent vectors F(z, y) 
is called the vector field (a ‘field’ of vectors), indicating the direction of the 
orbits. The orbits fit in so that their tangents coincide with the vector field. 

There are two special straight lines along which the tangent vector field is 
either vertical or horizontal; these are called the nullclines. The z-nullcline 
is the straight line ax + by = 0 where 2’ = 0, or the vector field is vertical. 
The y-nullcline is the straight line cx + dy = 0 where y’ = 0, or the vector 
field is horizontal. Finding and plotting the two nullclines are essential tools 
for sketching orbits. A picture showing several key orbits is called the phase 
diagram of the system (4.1)—(4.2). 
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Figure 4.3 The vector field indicating a clockwise, elliptical flow of the system 
xv’ =y, y’ = —4@ around the origin. The z-nullcline is the x axis (y = 0) where 
the vector field is vertical, and the y-nullcline is the y axis (x = 0) where the 


vector field is horizontal. 


Example 4.3 


For the system 


the vector field at the point (x,y) is given by 


Figure 4.3 shows the vector field, computed using software, at a set of points in 
the xy plane. Easily we can visualize the the rotational nature of the orbits. It is 
shown in the next example that the orbits are a family of ellipses x? + ty? =C 
that fit into this field. Without software we can make the following argument. 
If y > 0 (upper half plane), then 2’ > 0 and therefore « must be increasing; if 
y <0 (lower half plane) then 2’ < 0 and x must be decreasing. If « > 0 (right 
half plane), then y’ < 0, so y must be decreasing; if x > 0 (left half plane), then 
y’ > 0, so y must be increasing. Observe also that the vector field is vertical 
(up or down) along «’ = y = 0, which is along the x axis; the 2 axis is the 
x-nullcline. The vector field is horizontal (right or left) along y’ = —4a2 = 0, 
which is the y axis; the y axis is the x-nullcline. This is all consistent with the 
direction field in Figure 4.3. Note that even though a vector field for a system 
has a rotational nature, its orbits may not be closed paths, like ellipses. Orbits 
that spiral around and into the origin could equally fit the field. Therefore the 
vector field itself does not tell the whole story, but it can supplement analytical 
calculations to get fine structure properties of orbits. 
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In addition to the parametric representation of an orbit (i.e., the solution), 
there is another representation of an orbit as a relation between x and y, 
with time suppressed. If « = x(t), y = y(t) are known, it may be found by 
eliminating the time parameter ¢ in the parametric equations. For example, the 
set of parametric equations x(t) = t, y(t) = 2t?, —oo < t < oo, becomes, when 
time is eliminated, y = 2”, which is a parabola. In this latter representation, 
we know the orbit’s shape, but we lose the information about how it is traced 
out in time. 


Example 4.4 

Consider the linear system 
v=y, (4.3) 
y = —4e2. 

It is straightforward to check by simple substitution that 


a(t) = cos2t, y = —2sin 2t, 


cos 2t 
a ( —2 sin 2t ) 


is a solution. Using software we can plot the components immediately, as shown 
in Figure 4.4 (left panel). Clearly, the solution is oscillatory with period 7. 
We can also identify the orbit by eliminating the parameter ¢ to obtain a 
relationship between the coordinates x and y. Note that 2? = cos? 2¢ and 
y” = Asin? 2t; or x? = cos? 2t, ty? = sin” 2t. Adding the two equations gives 


or, equivalently, 


2 2 
ay =1 
seamed . 


which we recognize as an ellipse intersecting the coordinate axes at (0,+2) and 
(1,40). This form of the solution does not indicate the time dependence. On 
the other hand, the graph of the solution form x(t) gives specific information 
how the orbit is swept out as a function of time. Initially, at t = 0 it is at 
(1,0) and winds clockwise to: (0,—2) at ¢ = 1/4; (—1,0) at t = 7/2; (0,2) 
at t = 32/4; and returning to (1,0) at t = 7. Therefore, one oscillation is 
completed in 7 units of time. We can always find the direction along the orbit 
by examining the direction field of the system, as in the last example. This 
shows the elliptical orbit is clockwise. 
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Figure 4.4 Two plots showing the two representations of a solution to a sys- 
tem (4.3)—(4.4) for t > 0. (Left) The component plots x = cos 2t, y = —2 sin 2t, 
which are periodic, or oscillatory, of period 7. (Right) The corresponding clock- 
wise elliptical orbit in the zy-phase plane; it begins at (1,0) at time t = 0 and 
winds clockwise, making one revolution every 7 units of time. 


Remark 4.5 


(The Zero Solution) The linear system (4.1)—(4.2) always has the solution 
x(t) = 0, y(t) = 0, or x(t) = 0, which is the zero solution. In the phase plane 
this orbit consists of a single point, 0 = (0,0), and the orbit remains there 
for all time. This solution is an equilibrium solution because it does not 
change in time. The point (0,0) represented by this solution is called a critical 
point. Systems of differential equations can have other equilibria, or constant, 
solutions at other points; this important concept is discussed in Section 4.3. 


Method of Elimination 


At the beginning of this section we showed that a second-order equation 
could be easily transformed to a system of two first-order equations. Now we 
show the converse—a linear system can always be converted to a single second- 
order equation. 

Consider the linear system 


/ 


x =ax-+ by, 4.5 
] 


/ 


y =cx+dy. 


We can eliminate one of the variables, say y, to obtain a second-order, linear 
differential equation with constant coefficients for « = x(t). This takes 2 steps. 
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(i) Take the derivative of the first equation, and then substitute y’ from the 
second. (ii) Substitute for y from the first equation. Analytically, 


x” = aa’ + by’ 


= az’ + b(cx + dy) 


=az' + bex + d(x’ — az). 
Rearranging terms, we obtain an equivalent second-order equation 
x" —(a+d)a' + (ad — cb)x = 0. (4.7) 


It is clear that we can solve the system (4.5)—(4.6) for x = x(t), y = y(t) by 
solving (4.7) for a(t) and using (4.5) to find y(¢): 


y(t) = (a! — az). (4.8) 


The method for solving (4.5)—(4.6) using (4.7)—(4.8) is called elimination. It 
gives us the form of the general solution to (4.5)—(4.6), and it indicates what 
to expect from any planar, linear system. 


Example 4.6 

(Elimination) Consider the simple linear system from the preceding example, 
av’ =y, (4.9) 
y = —4ex. (4.10) 


Taking the derivative of the (4.9) and then using (4.10) immediately gives 
gc’ =y' =—4z, 


or 
xv’ +4e = 0. 


From Chapter 2, the general solution is oscillatory and has the form 
x(t) = cy, cos 2t + cp sin 2t. 
Therefore, using y = x’, we get 
y(t) = —2c, sin 2t + 2c cos 2t. 


Therefore the general solution to the system (4.3)—(4.4) in vector format is 


<S C1 cos 2t + co sin 2t _ cos 2t ie sin 2t 
~ \ 9, sin2t+2e.cos2t /) + \ —2sin2t 2\ 2cos2t }” 
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Remark 4.7 


Note the form of the solution in Example 4.6. In vector format it is the linear 
combination of two vector solutions 


cos 2t sin 2t 
xa(6) ( —2sin 2t ) ane KO ( 2 cos 2t ) 


This example shows what to expect from any linear system: the general solution 
is a linear combination of two basic vector solutions. 


Next we state some fundamental theorems similar to those in Chapter 2 for 
second-order equations. To proceed we need some terminology. If two solutions 


= (Gr) ome 200-2) 


have the property that their components satisfy 
W (t) = d1(f)vo(t) — do(t)di(t) #0 for all ¢, 


then we say x;(t), X2(t) is a fundamental set of solutions. The function W (t) 
is called the Wronskian of x(t), x2(t). The non-vanishing of the Wronskian 
for all t is a way of saying the two solutions are independent. For example, 
taking the two solutions Remark 4.7, the Wronskian is 


W(t) = (cos 2t)(2 cos 2t) — (—2 sin 2t)(sin 2t) = 2 cos? 2t + 2sin? 2t = 240 


for all t. Therefore these two solutions are linearly independent and form a 
fundamental set. 


Theorem 4.8 


(Superposition) If x;(t) and x2(t) are any two vector solutions of the linear 
system (4.5)—(4.6), then x(t) = c1x1(t) + c2x2(t) is a solution for any constants 
c, and cg. 


Theorem 4.9 
(Uniqueness) The initial value problem 
x’ = az + by, (4.11) 
y' = cx + dy, (4.12) 
r(to)=20, y(to) = yo, (4.13) 


has a unique solution that is valid for —oo < t < oo. (Note: this implies two 
orbits in the phase plane cannot intersect.) 
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Finally, as illustrated by Example 4.6, we can write the form of the general 
solution to the system (4.5)—(4.6). 


Theorem 4.10 


(General Solution) If x;(¢) and x2(t) form a fundamental set of solutions of 
the linear system (4.5)—(4.6), then 


x(t) = Cy X1 (t) + C2X2 (t), (4.14) 


where c; and cz are arbitrary constants, is the general solution to (4.5)—(4.6). 
The general solution contains all possible solutions to the system for various 


choices of cy and co. 


This theorem gives the prescription for determining the general solution. If 
there are initial conditions, then they determine c, and cz and therefore the 
unique solution to the initial value problem, guaranteed by Theorem 4.9. 


Remark 4.11 


The method of elimination, that is, transforming a system into a single second- 
order equation, provides a method to find a fundamental set of solutions x(t), 
x(t) and therefore the general solution (4.14) to a linear system. See Example 
4.6. However, a procedure using matrices, discussed in the next section, is a 
more elucidating approach to this problem. 


Example 4.12 


The system 
x =y, y =42 


can be transformed immediately into the second-order equation 2” — 4x = 0, 


which has solution 
2t 


a(t) = cye™ + coe 
Therefore, because y = 2’, 


y(t) = 2c10e7" — 2cne7?*. 


In terms of vectors, the general solution is 


prt ent 
x(t) = cr ( 2¢2t ) + C2 ( —%e-2t ) : 
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The Wronskian of the two solutions is 
W(t) = e* (—2e7**) — 2c" (e~*) = -4 £0. 


So the two vector solutions above form a fundamental set. If we impose and 
initial condition x(0) = 0, y(0) = 1, then 


w=a(s)oa(2)=(1) 


Therefore, 
C1 + ¢2 = 0, 
2c, 2c2 —= 1, 
which has solution c; = i, Q= —i. Therefore the unique solution to the initial 


value problem is 


1 et 1 e72t 
th=- eae 
x( ) 4 ( Qe2t ) 4 ( —2Qe—2t ) 
There is another technique that applies to simple systems, leading to a 
formula for the orbits in terms of x and y, without the time-dependence. 


Example 4.13 


Consider again the system 


Here, x and y are functions of t. But if ¢ is eliminated, then y can be written 
as a function of x. We can use the chain rule to get an expression for dy/dz, 


as follows. 
dy — dy dx 
dt dx dt’ 
so 
dy _dt/dt = —4a 
dx dxf/dt y— 
Therefore we obtained a first-order differential for y in terms of x, and we lost 
dependence on t. This amounts to dividing the two original equations. Now the 


equation is easily solved by separating variables to get 


1 
g? + iv =C, C constant. 
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These are concentric, elliptical orbits of the system expressed in terms of a 
single parameter C. A specific orbit can be determined from initial conditions. 
For example, if «(0) = 1 and y(0) = 2, then C = 1! + 42? = 2. Therefore the 
orbit is x? + Fy? = 2. 


Remark 4.14 

(Division of Equations) In general, if we have a system 
x’ =ax + by, 
y/ = cx + dy, 


then, as in Example 4.13, we can divide the two equations to obtain 


dy  cu+dy 
dx ax+by’ 


This first-order equation is a differential equation for the orbits in terms of x 
and y, with time-dependence suppressed. We can find all the orbits by finding 
the general solution. However, this method works easily for only the simplest 


systems. 


Remark 4.15 


(Laplace transforms) Another approach to solving linear systems is by 
Laplace transforms, the subject of Chapter 3. If X(s) is the transform of x(t), 
and Y(s) is the transform of y(t), then taking the transform of each equation 
in (4.5)-(4.6) gives 


4.15) 


( 
(4.16) 


We can solve this system of two algebraic equations for X(s) and Y(s) and 
then return to the time domain using the inverse transform. This method is 


best for problems with piecewise continuous or point sources. 


As a final definition, a first-order nonhomogeneous system has the form 


a’ = aa + by + filt), 
y = ca + dy + fait), 
where f(t) and fo(t) are the two components of the vector source f(t). The 


method of elimination transforms this system into a nonhomogeneous second- 
order equation. We discuss nonhomogeneous equations in Section 4.5. 
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EXERCISES 


1. Find and plot the following parametric curves in the phase plane for —co < 
t < oo by eliminating the time from the equations. 


a) v=3sin2rt, y = 4cos2nt. ec) g=-1, y= 2. 


b) «= 3cosht, y =sinht. d)¢g=e", y= —2e**. 


2. By dividing the following equations and integrating, find the equation of 
the orbits in terms of x and y for the following systems. Plot several repre- 
sentative orbits in the phase plane. Find the general solution of each system 
in component form and in vector form, indicating the fundamental set of 


solutions. 
a) a =—3y, y’ = 22. c) a’ = —3a, y’ = 2y. 
b) a! = —-2y, y! = —4z. d) a’ =4y, y' = 2y. 


3. Use the method of elimination to find the general solution and write it as 
a linear combination of two vector solutions. 


a) wv =a, yo =x 2y. c) a =ax4+2y, y’ =z. 
b) a =a-y, y' =a+y. d) a’ =—ax—-2y, y’ = 2x -y. 


4. Formulate a system of differential equations for the crop-soil model in 
Example 4.2 if there is a constant application k of the pesticide onto the 
soil. 


4.2 Matrices and Linear Systems 


The study of systems of differential equations is greatly facilitated by matrices. 
It provides a convenient and concise language and notation to express many of 
the ideas. Complicated formulas are simplified considerably in this framework, 
and matrix notation is independent of the number of equations. In the section 
we present a brief introduction to square matrices of dimension two. It does 
not represent a thorough treatment of matrix theory, but rather a limited 
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discussion centered on ideas required to solve systems of differential equations. 
In Section 4.2.2 we formulate a system of differential equations in terms of 
matrices and use the formulation to study equilibrium solutions of the system. 


4.2.1 Preliminaries from Algebra 


Matrices and Vectors 

A square array A of numbers having 2 rows and 2 columns is called a square 
matrix of size 2, or an 2 x 2 matrix; we say, “2 by 2 matrix”. The number in 
the ith row and jth column is denoted by aij. A general 2 x 2 matrix has the 
form 


The numbers a;; are called the entries in the matrix; the first subscript 7 
denotes the row, and the second subscript j denotes the column. The main 
diagonal of a square matrix A is the set of elements a11, a22. We often write 
matrices using the brief notation A = (a,;). A vector x is a column list of 
numbers x1, £2, called components, 


Vectors are denoted by lowercase boldface letters such as x, y, etc., and matrices 
are denoted by capital letters such as A, B, etc. To minimize space in typeset- 
ting, we often write a vector x as a transposed row list, or x = (a,22)'. The 
T means transpose, or turn the row into a column. 

Two square matrices can be added entrywise. That is, if A = (a;;) and 
B = (6;;) are two matrices, then the sum A+ B is a matrix defined by A+B = 
(aij +0;;). A matrix A = (a;;) can be multiplied by a constant c by multiplying 
all the elements of A by the constant; in symbols this scalar multiplication 
is defined by cA = (ca;;). Thus —A = (—a;;). It is clear that A+ (—A) = 0, 
where 0 is the zero matrix having all entries zero. Subtraction is defined by 
A-—B=A+4(-B). Further, A+ 0 = A. Addition is both commutative and 
associative. Therefore the arithmetic rules of addition for matrices are the same 
as the most of the usual rules for addition of real numbers. 

Similar rules hold for addition of vectors and multiplication of column vec- 
tors by scalars. These are the definitions encountered in multivariable calculus 
where vectors are regarded as elements of R?. Vectors add componentwise, and 
multiplication of a vector by a scalar multiplies each component of that vector 
by that scalar. 


192 4. Linear Systems 


Example 4.16 


Let 


The product of two square matrices is not found by multiplying entrywise. 
Rather, matrix multiplication is defined as follows. Let A and B be two matri- 
ces. Then the matrix AB is defined to be the matrix C = (c;) where the 77 
entry in the product C is found by taking the product (dot product, as with 
vectors) of the ith row of A and the jth column of B. In symbols, AB = C, 
where 

Cig = a+ by = Gi1b1; + Gizba;, 

where a; denotes the ith row of A, and b; denotes the jth column of B. 
Generally, matrix multiplication is not commutative (i.e., AB # BA), so the 
order in which matrices are multiplied is important. However, the associative 
law AB(C) = (AB)C does hold, so you can regroup products as you wish. The 
distributive law connecting addition and multiplication, A(B+C) = AB+ AC, 
also holds. The powers of a square matrix are defined by A? = AA, A? = AA?, 
and so on. 


Example 4.17 


Let 
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The special square matrix having ones on the main diagonal and zeros off 
the diagonal is called the identity matrix and is denoted by J. That is, 


ra(3 4) 


It is easy to see that if A is any square matrix and J is the identity matrix, 
then 
AI=IA=A. 


Therefore multiplication by the identity matrix does not change the result, a 
situation similar to multiplying real numbers by the unit number 1. If A is a 
given matrix and there exists a matrix B for which 


AB = BA=I, 


then B is called the inverse of A and we denote it by B = A~!. If Aq! exists, 
we say A is a nonsingular matrix; otherwise it is called singular. Thus, 


AATE = AVA = FT, 


We never write 1/A for the inverse of A. 

Next we define multiplication of an 2 x 2 matrix A times a vector x. The 
product Ax with the matrix on the left, is defined to be a vector whose ith 
component is a; - x. In other words, the ith element in the list Ax is found by 
taking the product of the ith row of A and the vector x. Precisely, 


_fa b zc \ { ax+by 
Bolo a) la) Shera) 


For a numerical example take 


an( 3a) (4) 
w= ( 7507 )-( 5): 


The product of a vector times a matrix, xA, with the matrix A on the right, 
is not defined. 


A useful number associated with a square matrix A is its determinant. The 
determinant of a square matrix A, denoted by det A is the number 


Then 


det A = det ( a,b ) = aac 
c od 
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For example, 


2 6 
act ( ~ p ) =2-0-(-2)-6=12, 


Using the determinant we can give a simple formula for the inverse of a 
matrix A. Let 
a b 
A — 
Coa) 
and suppose det A 4 0. Then 


| d —b 
= Te ee ty cet) 


So the inverse of a 2 x 2 matrix is found by interchanging the main diagonal 
elements, putting minus signs on the off-diagonal elements, and dividing each 
entry by the determinant. 


Example 4.18 
If 


then 


gate 1 3.-2\_ 1 3-2 
~ dettA\ —-4 1/ -—5\ -4 1 


The reader can easily check that AA~! = J. 


Ne 
II 
oo oS 

| 
ousooo 
| 
oro 
ad 


Equation (4.17) shows that the inverse matrix exists if, and only if, the 
determinant is nonzero. Formally, 


A! exists if, and only if, det A ¥ 0. 
This is a major result in matrix theory, and it is a convenient test for invert- 
ibility of a matrix. 
Systems of Algebraic Equations 


Matrices were developed to represent and study linear algebraic systems (m 
linear algebraic equations in n unknowns) in a concise way. Here we are taking 
m =n = 2. Consider two equations in two unknowns 21, £2 given in standard 
form by 


a4, 21 + a12%2 = by 


G21 21 + A22X%2Q = bo. 
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Using matrix notation we can write this as 


(a eee ee. 
a21 422 v2 bo 
In more concise notation this system is simply 


Ax =b, (4.18) 


b 
421 422 v2 be 
A is called the coefficient matrix, x is a vector containing the two unknowns, 
and b is a vector representing the right side of the equations. If b = 0, the zero 


vector, then the system (4.18) is called homogeneous. Otherwise it is called 
nonhomogeneous. Geometrically, in a two-dimensional system each equation 


where 


represents a line in the plane. A solution vector x is represented by a point that 
lies on both lines. There is a unique solution when both lines intersect at a single 
point; there are infinitely many solutions when both lines coincide; there is no 
solution if the lines are parallel and different. When b = 0 the two lines pass 
through the origin and x = 0 is always a solution to the homogeneous system; 
or, there are infinitely many solutions when the lines coincide. The following 
theorem tells us when a linear system Ax = b of 2 equations in 2 unknowns is 
solvable. It is a important result that is applied often in this chapter. 


Theorem 4.19 


(1) If det A # 0, then the system Ax = b has a unique solution given by 
x = A7'b; the homogeneous system Ax = 0 has only the trivial solution 
x=0. 


(2) If det A = 0, then the homogeneous system Ax = 0 has infinitely many 
solutions; the nonhomogeneous system Ax = b either has no solution or 


has infinitely many solutions. 


It is easy to show the first part of the theorem, when A is nonsingular, or 
det # 0, using the machinery of matrix notation. Multiplying both sides of 
Ax = b on the left by A~! gives 


A~'Ax = A~'b, 
Ix = A7'b, 
x= Aq'b, 
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which is the unique solution. In the case A is singular, or det A = 0, we can 
appeal to a geometric argument as follows. The two lines represented by the 
two equations must be parallel (you should show this), and therefore they either 
coincide or they do not, giving either infinitely many solutions or no solution. 


Example 4.20 


Consider the homogeneous linear system 


Gee. 


The coefficient matrix has determinant zero, so there will be infinitely many 
solutions. The two equations represented by the system are 


4¢, +242 =0, 82, + 22% =0, 


which are clearly not independent because one is a multiple of the other. There- 
fore we need only consider one of the equations, say 4%, + x2 = 0. With one 
equation in two unknowns we are free to pick a value for one of the variables 
and solve for the other. Let x; = 1; then x2 = —4 and we get a single solu- 
tion x = (1,—4)?. More generally, if we choose 2; = a, where a is any real 
parameter, then x2 = —4a. Therefore all solutions are given by 


(2)-(h)-a(4) 8 


Thus all solutions are multiples of (1,—4)™, and the solution set lies along the 
straight line through the origin with slope —4. Geometrically, the two equations 


represent two lines in the plane that coincide. 


The set of all solutions to a homogeneous system Ax = 0 is called the 
nullspace of A. The nullspace consists of a single point x = 0 when A is 
nonsingular (det A 4 0), and it is a line passing through the origin in the case 
where A is singular (det A = 0). For example, the straight line x2 = —42, is 
the nullspace of the matrix A in the last example. 

There is a simple, easily verified, algorithm to solve nonhomogeneous sys- 
tems of two equations in two unknowns, called Cramer’s rule. 


Theorem 4.21 


Cramer’s Rule) The solution to the nonhomogeneous linear system 
g 
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is 


det ( bi ai2 ) Act ( ai by ) 
a bo a22 “ a21 be 
: det A _ det A 
Example 4.22 
Solve the linear system 
2x — 3y =4, 
4x —y=-l. 


The coefficient matrix is 


Gua 


which has determinant det A = 10. Therefore, using Cramer’s rule, 


4 -3 2 4 
aet( 2) 3 act ( | = eT 


10 ~ 49’ ¥ 10 ai 


Next we introduce the notion of linear independence of a set of vectors in 
the plane. Two vectors 


re(3) ve Gn) 


are linearly independent if one of them is not a multiple of the other. We 
can express this statement equivalently as follows. The set v, w of vectors is 
linearly independent if the only linear combination of the vectors equaling the 
zero vector is the zero combination; that is, if 


avtcow =O, 


then c; = co = 0. This is easily rewritten in matrix form as a homogeneous 
system for c, and co: 


If 
act ( ee ) #0, (4.19) 


then the only solution is the trivial solution c; = cg = 0, implying v, w is a 
linearly independent set. If two vectors are not linearly independent then one 
is a multiple of the other and the determinant in (4.19) is zero; in this case we 
say the vectors are linearly dependent. 


198 4. Linear Systems 


EXERCISES 


1. Let 
1 3 —-1 0 2 
4=(aa) 8=(a 7) (5): 


Find A+B, B—4A, AB, BA, A?, Bx, ABx, A~!, det B, B®, AI, and 
B-}, 


2. Let A be the matrix in Exercise 1. 


a) With b = (2,1)7, solve the system Ax = b for unknown x using the 
inverse matrix A7!. 


b) Solve the same system by Cramer’s rule. 
c) Illustrate the solution geometrically in the xy plane. 
3. Let A be the matrix in Exercise 1. 


a) Find all values of the parameter that satisfy the equation det 
(A — XI) = 0. 


b) For each of the values of » determine the solution of the system 
(A — AI)x = 0. 


4. Repeat Exercises 2 and 3 for the matrix B in Exercise 1. 


5. Let 
2 =1 
pC 22), 


Compute det A. Does A7! exist? Find all solutions to Ax = 0 and plot the 
solution set in the plane. What is the nullspace of A? 


6. Write each system in matrix form, and for each system determine all values 
m for which the system has no solution, a unique solution, or infinitely 
many solutions. 


a) 2e+3y=m, —6x—9y =5. c) ma —2y=0, 2x+4y=0. 


b) 2a +my=6, ct+y=2. d) mz+3y=m, 3x¢—my=1. 


7. If a square matrix A has all zeros either below its main diagonal or above 
its main diagonal, show that det A equals the product of the elements on 
the main diagonal. 


8. Use the definition of linear independence to show that the vectors (2, —3) 
and (—4,8)* are linearly independent. 
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4.2.2 Differential Equations and Equilibria 


A two-dimensional linear system of differential equations 


x’ =ax+by, (4.20) 
y =cx+dy, (4.21) 


where a, b, c, and d are constants, can be written compactly using vectors and 


“- (8). (25) 


matrices. Denoting 


or 


Simply stated, 

x’ = Ax, (4.22) 
where we suppressed the understood dependence of z on t. Because the right 
sides of the equations (4.20)—(4.21) do not contain time t explicitly, we say the 
system is autonomous. 


Equilibria and Stability 


Just as for first-order autonomous equations studied in Chapter 1, the equi- 
librium, or constant, solutions and their stability are key concepts in the study 
of linear and nonlinear systems of differential equations. An equilibrium solu- 
tion of x’ = Ax, or (4.20)—(4.21), is a constant vector solution x(t) = x* for 
which 

Ax* = 0. 
This is clearly equivalent to 
ax* +by* =0, cx* +dy* =0 


where x* = (*, y*)?. The component representation of an equilibrium solution 
is two constant functions x(t) = «*, y(t) = y* plotted against t. Because an 
equilibrium solution plots as a point in the phase plane, we refer to it as a 
critical point and use the notation x* = («*,y*), without the transpose. 
Obviously, the critical points, or equilibria, are solutions of 


ax+by=0, cx+dy=0, 


which are at the intersections of the two straight lines ax+by = 0 and cr+dy = 
0. The theorem summarizes what we know. 


200 4. Linear Systems 


Theorem 4.23 
The linear system x’ = Ax has: 
1. A unique equilibrium at (0,0) if det A 4 0. 
2. A straight line of equilibria if det A = 0. 
If the origin (0,0) is the only critical point, we say the origin is an isolated 


critical point because there is a neighborhood of (0,0) that contains no other 
critical point. Otherwise it is called nonisolated. 


Remark 4.24 


The system 
x’ =Ax+b, detA#O, (4.23) 


where b = (b1,b2)" is a constant vector, is also an autonomous system, but it 
is nonhomogeneous. A critical point x* for (4.23) is found by setting the right 
side equal to zero, or Ax* + b = 0. Hence, 


x* = —A7'b. (4.24) 


Nonhomogeneous systems (4.23) can be reduced to a homogeneous system of 
the form (4.22) by translating the critical point to the origin as follows. Let 


y=x-x". (4.25) 
Then 
y =x’ = Ax+b=A(y+x*)+b= Ay+ Ax* +b= Ay, 


where we used (4.24). Therefore we can solve (4.23) by solving y’ = Ay for y 
and then using (4.25) to get x. Note that if det A = 0, then A~! does not exist 
and there may be no equilibria to (4.23). 


Suppose a homogeneous system has an isolated critical point at (0,0). Intu- 
itively, the equilibrium is asymptotically stable if there is a small neighborhood 
(open circle) about (0,0) such that every orbit x(t) that starts in the circle at 
time t = to converges to (0,0) as t + oo. The origin is stable if nearby orbits 
stay nearby for all future time; they do not need to converge to the origin. The 
origin is unstable if it is not stable. Nature selects out the stable equilibria, 
so an equilibrium must be stable to be physically meaningful; in real systems 
there are always small changes from equilibrium. 
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For interested readers, a more technical characterization is: 


Definition 4.25 


1. The isolated equilibrium x* = 0 is asymptotically stable if, and only if, 
there is a circle C. : 77 +y? < € centered at the origin such that every orbit 
which begins in the circle C, at any time t = to approaches the origin as 
t+ +o. 


2. The isolated equilibrium x* = 0 is stable if, and only if, for every circle 
C.: 2? +y? < centered at the origin, there is a circle C5, 6 < €, inside 
inside C, such that every orbit which begins in the circle Cs at any time 
t = to remains in the circle C, for all times t > to. 


3. If the isolated equilibrium is not stable, then it is called unstable. 


It is clear that asymptotically stable implies stable. An asymptotically sta- 
ble equilibrium, where orbits approach the origin, is also called an attractor 
or sink. Some unstable equilibria are called repellers, or sources when they 
exit every neighborhood. If the orbits form set of concentric ellipses around the 
origin, it is stable; some texts use the term neutrally stable. We use these terms 
in the sequel to describe the types of equilibria that can occur in a system. 


EXERCISES 


1. Write each of the following systems in matrix format and identify the coef- 
ficient matrix. 


a) g = —2r — 3y, y’ = —x + Ay. d) x’ =—-2xr-y, y! = —4y. 
b) a’ = —3y, y = —-2a4+y. e) a =ax—2y, y’ = —2r4 + 4y. 
c) a = 2a, y' =a. f) «= —6y, y’ = by. 


2. Determine the critical points for the systems in Exercise 1. 


3. Find the critical points for each nonhomogeneous system and then trans- 
form the system into a homogeneous system. 


a) w = 24+ 3y, yo =—a- 14. b) a! = —a+3y-6, y/ = x742y-1. 


202 4. Linear Systems 


4.3 The Eigenvalue Problem 


Next we introduce matrix methods to solve the two-dimensional system 
x’ = Ax. (4.26) 


Referring to (4.20) and (4.21), we observe that a solution x(t), y(t) must have 
the property that x(t), y(t) and their derivatives have the same form if all 
terms are to cancel. Exponential solutions satisfy this criterion. Therefore, we 
attempt to find a solution of the form 


x = ve, (4.27) 


where A is a constant and v is a nonzero constant vector, both to be determined. 
Substituting x = ve and x/=Ave*" into (4.26) gives 


Ave = A(ve), 


or 
Av = dv. (4.28) 


Therefore, if some \ and v can be found that satisfy (4.28), then we have 
determined a solution of the form (4.27). Equation (4.28) is a famous, impor- 
tant problem in mathematics called the algebraic eigenvalue problem. The 
following remark summarizes the key idea in solving differential equations. 


Remark 4.26 


A nonzero constant vector v is an eigenvector of A if Av = Av for some 
A. The constant is called an eigenvalue of A. The pair ,v is called an 
eigenpair. Every eigenpair of A gives a solution x(t) = ve’ of x’ = Ax. 


Geometrically we think of the eigenvalue problem (4.28) like this: the matrix 
A represents a transformation that acts on vectors to produce vectors; that is, 
a vector v gets transformed to a vector Av. An eigenvector of A is a special 
vector that is transformed to a multiple (A) of itself; that is, AV = Av. 

In summary, we have reduced the problem of finding solutions to a system 
of differential equations to the problem of finding solutions of an algebraic 
problem—every eigenpair gives a solution to the system (4.26). In the remainder 
of this section we focus on solving the eigenvalue problem. In the next section 
we classify all the types of solutions the system x’ = Ax, depending upon the 
eigenvalues of A. 
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Solving the eigenvalue problem. We rewrite (4.28) as a homogeneous 
linear system 
(A—Al)v = 0. (4.29) 


This system has nontrivial solutions if the determinant of the coefficient matrix 
is zero, or 
det(A — AI) = 0. (4.30) 


Written out explicitly, this system (4.29) has the form 


Grr seles cy! 


where the coefficient matrix A—AIJ is the matrix A with \ subtracted from the 
diagonal elements. Equation (4.30) is, explicitly, 


act (“7 14 )=¢ \)(d — A) — cb = 0, 


or equivalently, 
d? — (a+ b)A + (ad — be) = 0. (4.31) 


Note that this equation is exactly the equation (4.7) that we obtained by the 
method of elimination in Section 4.2. This equation can be memorized easily if 
it is written 


d — (trA)A + det A = 0, (4.32) 


where trA = a+d is called the trace of A, defined to be the sum of the 
diagonal elements of A. Equation (4.31), or (4.32), is called the characteristic 
equation associated with the matrix A, and it is a quadratic equation in X. Its 
roots, found by factoring or using the quadratic formula, are the two eigenvalues 
of A. The eigenvalues may be real and unequal, real and equal, or complex 
conjugates. Once the eigenvalues are computed, we can substitute them in 
turn into the system (4.29) to determine corresponding eigenvectors v. 


SUMMARY. To solve the eigenvalue problem Av = Av : 
(1) Solve the characteristic equation det(A — AI) = 0, or 
d? — (trA)A + det A = 0, 
to determine the eigenvalues . 
(2) Successively substitute each eigenvalue A into the homogeneous system 
(A—AI)v =0 


to find the eigenvectors v that correspond to each i. 
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Before presenting examples, we state two important facts. 


(1) Any constant multiple of an eigenvector corresponding to an eigenvalue 
A is again an eigenvector for the same eigenvalue. This follows from the 
calculation 

A(ev) = cAv = c(Av) = XA(cv). 


Thus, an eigenvector corresponding to a given eigenvalue is unique up to a 
constant multiple. 


(2) If the eigenvalues are unequal, i.e., Ay A Ag, then the corresponding eigen- 
vectors v1, and v2 are independent. To prove this, assume not. Then vj 
and v2 are proportional. Hence there is a nonzero number c such that 


V2 = CV. (4.33) 
Multiplying on the left by A, we get 
Avo = cAvi, 


or 
A2V2 = CAV}. 


Next, multiply (4.33) by Az to get 
A2Ve2 = cA2V1- 


Subtracting the last two equations, we obtain 0 = c(A; — A2)v1. This 
statement is a contradiction because every term on the right is nonzero. 
Therefore, v; and vz are not proportional and must be independent. 


Example 4.27 


Consider the matrix 


inf 1) 


To find the eigenvalues we write the characteristic equation det(A — AI) = 0, 


or 
1-A 1 
det ( 4 a ) = 0, 
or 
(1—A)? —4 =)? —2)-3 =(A+1)A-3) =0. 
Thus the eigenvalues are 4; = —1 and Az = 3. Note that the characteristic 


equation is A? — (trA)A + det A = 0 where trA = 2 and det A = —3. 
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Now we find eigenvectors associated with each eigenvalue by successively 
substituting the eigenvalue into (A — AI)v = 0, or 


CU GL) =o): 


When A = —1 the system becomes 


21 UL _ 0 

4 2 v2 7 0 ‘ 
The two equations represented are 2v, + vo = 0 and 4v; + 2v2 = 0, which are 
the same. This is expected because the coefficient determinant is zero; that 
is how we obtain eigenvalues. Therefore we need to consider only one of the 


equations, say 2v, + vg = 0. The solution is vg = —2v,, where v, is arbitrary. 
Therefore take v1 = 1, and vg = —2, giving the eigenvector 


a 1 
V= 2 fs 
een u=(3) 


is an eigenpair. Recall, any multiple of an eigenvector is again an eigenvector; 


So 


but we only need to choose a representative one. 
Next we take Az = 3. Then (A — AJ)v = 0 becomes 


Cele. 


In the same manner as above we need to take only one of the two equations, 
say —2v,; + v2 = 0. Then choosing the solution v; = 1, vg = 2, we obtain the 


A2 = 3, w=(5): 


The same process works for complex eigenvalues. The complex eigenpairs 


second eigenpair 


are always complex conjugates. 


Example 4.28 


(Complex eigenvalues) Because eigenvalues are solutions to a quadratic 
equation, they may be complex conjugate numbers. The resulting eigenvectors 
will always be two complex conjugate vectors. Let 


4-(5 3). 
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The characteristic equation is 


—3 


—-2-X 
det(A~ M1) = det ( 3 bash 


)=¥ 444180. 


Using the quadratic formula, we get eigenvalues } = —2 + 31. Next we find 
eigenvectors associated with A = —2 + 3% by solving the system (A— AI)v = 0, 


or 
—2— (-2+ 31) —3 v1 \_ [f 0 
3 —2— (—2 + 3i) ve) \O/’ 
or, in component form, 
—3iv1 = 32 = 0, 
3U1 = 3iv2 = 0. 


These equations are proportional (the second is i times the first), as expected, 
so we need to consider only one, say 3v1; — 3ivg = 0. Taking ve = i we get 


vy = —1. So the eigenvectors corresponding to \ = —2 + 37 are all multiples of 
hat 
V1= a % 
a 
The eigenvectors associated with A = —2 — 32 are all multiples of 


m=(7), 


which is the complex conjugate of the vector v,. The eigenpairs are 
-1 

—2+ 31, ( . ) : 
xt 


EXERCISES 


1. Find the eigenvalues and eigenvectors of the following matrices. 


C44) 9C2s) ak 


ND vile 
| | 
NR Alot 
Sia 
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HS eS, af ee) 
a2) ace 32) 


2. Find the eigenvalues of the following matrices and describe their depen- 
dence on £3. 


9(i6)  %( #) 9 (28 4): 


3. Show that det A = 0 if, and only if, A = 0 is an eigenvalue. 


4. If \ is a nonzero eigenvalue of a matrix A, show that \~! is an eigenvalue 
of the inverse matrix A7!. 


5. If \ is an eigenvalue of a matrix A, show that \” is an eigenvalue of the 
matrix A”, where n > 2 is an integer. 


6. Can A = 0 be an eigenvalue of a matrix A? Give an example. 


0 1 


7 tet A=(_5 _3 


) . If (1,—2)7 is an eigenvector, what is the eigen- 


value? 


4.4 Solving Linear Systems 


We learned to solve the eigenvalue problem and now we are ready to classify 
and solve linear systems, depending on their eigenvalues. There are multiple 
cases because the eigenvalues of the matrix A can be real and unequal, real and 
equal, complex, or purely imaginary. The key idea is that each eigenpair A, v 
leads to a solution x(t) = ve. In carrying out this process we also relate the 
structure of the solution to the orbits they represent in the phase plane. The 
structure of the orbits also elucidates the stability properties of the equilibria 
of the system. 


4.4.1 Real Unequal Eigenvalues 


In this section we begin analyzing the various solution forms of a linear system 
x’ = Ax, depending on the nature of the eigenvalues of the coefficient matrix 


A. 
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If the two eigenvalues of the system 
x’ = Ax 


are real and unequal, say 4; and 2, then corresponding eigenvectors v; and 


v2 are independent and we obtain two independent solutions x(t) = v,e* 
and x2(t) = v2e*2'. The general solution of the system is then a linear 
combination of these two independent solutions, 

x(t) = cyve™ + covge??, (4.34) 


where c; and cz are arbitrary constants. 
To understand the orbital structure in the phase plane, there are three 
subcases to consider: 


(i) Ay and Az have opposite signs. 
(ii) Ay and Az are both negative and unequal. 


(iii) A; and Az are both positive and unequal. 


Example 4.29 


(Eigenvalues with opposite signs) We start with a simple representative 
equation where eigenvalues have opposite signs, namely the system 


The two eigenpairs of the coefficient matrix A are very easily found to be 


A, =-1, u=(5) and A2 = 1, u=(1). 


The general solution is 


x@)=a( 4 )et+a/( : Je. 


which is a linear combination of the two basic solutions 


see ( : i eG) = ( : Je. 


The first basic solution x (¢) associated with the negative eigenvalue represents 
an orbit moving toward the origin along the positive x axis. The solution —x, (¢) 
is an oppositely opposed orbit moving toward the origin along the negative x 
axis. Similarly, the second basic solution x2(t) associated with the positive 
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eigenvalue represents an orbit moving away from the origin on the positive y 
axis, and —x2(t) is an oppositely oppose orbit moving away from the origin on 
the negative y axis. See Figure 4.5. What about the other oribits? In this case we 
can find them exactly by dividing the differential equations to get y'/y = —a'/x 
and integrating to find zy = C, where C is a constant. (Alternately, you could 
' y = cee! and note the same 
result.) These orbits are hyperbolas y = C/x, also shown in Figure 4.5. This 
type of orbital structure is called a saddle structure and the origin is called a 
saddle point. A saddle point is clearly an unstable equilibrium. This example 
is representative of all systems with real unequal eigenvalues. 


write the solution in component form x = c,e7 


YA 


Figure 4.5 The phase plane diagram for Example 4.29 showing a saddle 
structure near the origin. The origin is called a saddle point and it is unstable. 


Example 4.30 

Consider the system of differential equations 
we =axt+y, 
y =4e+y, 


or 


an 
~\ 4 1 , 


The coefficient matrix for the system is the same as in Example 4.27, which 
has eigenpairs 


A, =-1, u=( 3) and A2 = 3, u=(3): 


Therefore, a fundamental set of solutions is 


x= ( - Jet nb Sages ( : je 
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Therefore the general solution to the system is 


x(t) =a ( 3 Jetta : a (4.35) 


where c; and cz are arbitrary constants. 
Again, this is a saddle structure. First consider x; (t). It is a scalar (function) 


1 ee . : 
e~* times the eigenvector ( 9 ). Therefore the solution is a straight line 


of slope —2/1 = —2 along the direction of the eigenvector. The parametric 
equations of this solution are 


a(t) =e *, y(t) =—-2e*, -00 <t< +00. 


As t — +00, the solution approaches the origin (0,0); as t + —oo, the solution 
approaches infinity. In summary, as t ranges forward in time from —oo to +00, 


Figure 4.6 The linear orbits for Example 4.30: two pairs of opposing rays, 
one pair coming toward the origin (associated with the negative eigenvalue), 
and one pair leaving the origin (associated with the positive eigenvalue). 


the orbit corresponding to the solution is traced from infinity to (0,0) along 
the straight line in the 4th quadrant. See Figure 4.6. Notice that 


x(t) —2e* 
"Okara or y(t) = —20(t), 
confirming the solution is on the line y = —2a. We call such a straight line 


solution a linear orbit. Corresponding to x(t) is the oppositely opposed orbit 
—xj,(t) in the second quadrant. Figure 4.6. In the same way, the solution 


x2(t) = ( : je 
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represents a outgoing ray in the first quadrant going from (0,0) to infinity as 
t varies from —oo to +00 along the line y = 27. Again, —x2(t) is an outgoing, 
oppositely opposed ray in the third quadrant. 

What about the other oribits? In (4.35) note that as t + +oo we have 
e-' +0 and 


1 
x() >a ( 5 je as t + +00. 


Therefore all the orbits approach the line y = 2a, which is in the direction of 
the eigenvector associated with the positive eigenvalue. In the same way, as 
t + —oo, backward in time, e®* + 0 and 


1 
xi) a ( _ Jet as t + —oo. 


Therefore the orbits approach the straight line y = —2a# backward in time, 
which is in the direction of the positive eigenvalue. Thus, the orbits have a 
hyperbolic shape as they come toward the origin and veer away, approaching 
the linear orbits associated with the positive eigenvalue. Again we get a saddle 
structure as shown in Figure 4.7. In this case we also call the linear orbits 
separatrices because they separate different types of orbits in the phase plane. 


Figure 4.7 The phase plane diagram in Example 4.30 showing the linear 
orbits and the hyperbolic-like orbits that approach the linear orbits associated 
with the positive eigenvalue. Again, the origin is a saddle point. In the case of 
a saddle point, the linear orbits are called separatrices. 


Finding the linear orbits of any system with two real eigenvalues is an 
essential tool in constructing the phase diagram. We highlight this important 
geometrical interpretation of a solution x(t) = ve to a linear system. 
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Remark 4.31 


If \ is a real eigenvalue of the linear system x’ = Ax with corresponding real 
eigenvector v, then the solution x(t) = ve*! of the linear system is called a 
linear orbit. In the phase plane it plots as a ray along a straight line in the 
direction of the eigenvector v, either entering the origin (if \ < 0) or exiting 
the origin (if \ > 0). Further, x(t) = —ve* is a linear orbit in the opposite 
quadrant with the same properties. Therefore, an eigenpair gives rise to two 
opposing rays, both either approaching the origin or both exiting the origin. 
Hence, every nonzero real eigenvalue leads to two opposing linear orbits, or 
rays, in phase space. 

In summary, each independent solution, x(t) = vie"! and x2(t) = ver", 
represents a linear orbit, or ray, in the phase plane in the directions of the 
eigenvectors v1 and vg, respectively. Their negatives —x,(t) and —x2(t) repre- 
sent opposing linear orbits or rays in the opposite quadrants. Opposing orbits 
enter the origin for negative eigenvalues and leave the origin for positive eigen- 
values. 


Example 4.32 


(Both eigenvalues negative) Consider a representative system consisting of 
the decoupled equations 


xg = —2, 
y! = —2y. 
Because the equations are decoupled, we can solve them directly to get 


a(t)=ce’, y(t)=c@e”. (4.36) 


In vector form the solution is 


dna} )etra( olen 


It is clear that the eigenvalues are ) = —1, —2 with corresponding eigenvec- 
tors (1,0)? and (0,1)?. Each basic solution represents a pair of opposing linear 
orbits along the x and y axes, respectively. Both sets of linear orbits approach 
the origin as t + +00 because both eigenvalues are negative. Therefore, all 
solutions decay and their orbits approach the origin. Here, we can find the 
shapes of the orbits by eliminating the time parameter t. Square the first equa- 
tion in (4.36) and then divide the two equations to get 
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which are parabolas. If C' > 0 they are concave up, and if C’ < 0 they are 
concave down. When C' = 0 we get y = 0, or the the positive and negative x 
axes; these are the linear orbits. The positive and negative y axes are also linear 
orbits found by taking c; = 0. See Figure 4.8. In addition, the direction field 
has components (—2, —2y); therefore, in the first quadrant curves approach the 
origin (x’ < 0, y’ < 0), and similarly for the other three quadrants. This type 
of structure is called a nodal structure, and the origin is an asymptotically 
stable node. This example is characteristic of systems with negative, unequal 


eigenvalues. 


Figure 4.8 Orbits for the system x’ = —z, y! = —2y, giving an asymptotically 
stable node at the origin. The direction field in each quadrant is shown as well. 


Example 4.33 

Consider a slightly more complicated system 
x’ = —2x + 2y, 
y = 2a — By. 


The eigenpairs are 


4(2).-6(2) 


The component form of the general solution is 


a(t) = 2ce7* + coe, 


y(t) = ce’ — 2cge"™, 
where c, and cz are arbitrary constants. The eigenvalues are —1 and —6, so the 
origin is an asymptotically stable node. Let’s inquire about the phase diagram. 
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How do the orbits enter the origin as t + +00? For very large t, the e~° 


term decays much faster than the e~* term. Therefore, in the limit the general 
solution approaches 


x(t) ~2qe', as t— +00, 


y(t) ce *, as t— +00, 


which has the same direction as the is the linear orbit associated with the 
eigenvector, 


x(t) = 2ce~*, 
y(t) =cie~*. 


Thus, all orbits approach the origin tangent to the line y = #/2 as t +00. 


As t + —oo (backward in time) the term e~® dominates the term e~* as t 
gets large negatively. Consequently, on any orbit 
a(t) ¥c2,e®, as t—>—o0, 
y(t) % —2cge-®*, as t— —o0. 
Therefore the slope of all limiting orbits at t = —oo coincides with the linear 
orbits associated with the eigenvalue \ = —6. In summary, for large negative t, 


all the orbits become parallel to the line y = —2z. Figure 4.9 shows the phase 
diagram. 


Figure 4.9 The linear orbits and the behavior of orbits as t + +co and as 
t — —oo. The orbits enter the origin tangent to one linear orbit; they come 
from a direction parallel to the other linear orbit. We have labeled the linear 
orbits by their eigenvalues. The origin is an asymptotically stable node. 
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Example 4.34 


(Both eigenvalues positive) In this case the exponential factors e*** and 


e*2* eo to infinity as tf + +oo. Thus, both pairs of linear orbits approach 
infinity as t + +00 along the rays defined by the two eigenvalues. From the 
general form of the solution, equation (4.34), all of the orbits of the linear 
system exit the origin at t = —oo and approach infinity as t — +-oo. The phase 
plane diagram is very similar to the case of negative eigenvalues, but with the 
direction arrows reversed; they all go outward. Positive eigenvalues give a nodal 
structure and the origin is called an unstable node. Using a simple example 
we show that all the orbits leave the origin at t = —oo along the direction 
of the eigevector associated with the smallest positive eigenvalue. Suppose the 
solution of a system in component form is 


x(t) = cet + coe”, 


y(t) = 2cre’ — 2coe**, 


where c; and cg, are arbitrary constants. Then the eigenpairs are 1, (1,2)" 
and 4, (1,—2)T. As t + —oo (backward in time) we have x(t) > cie’ and 
y(t) + 2cye’ because e* dominates e® when ¢ is large and negative. Thus 
y(t)/x(t) > 2 as t + —oo. Hence the curves at the origin are tangent to 
the direction (1,2) of the eigenvector associated with the smallest eigenvalue 
near the origin. One can observe that all orbits approach the direction of the 
eigenvector associated with largest eigenvalue as t + +00. 


The case det A=0 


We have not discussed the case when zero is an eigenvalue, which is true if, 
and only if, det A = 0. In this case all the critical points are non-isolated and 
lie on single line ax + by = 0 (or cx + dy = 0, which is the same); this means 
the two equations are proportional. Each point on the line represents a point 
orbit, or constant solution, and the system remains at that state for all time. 
Figure 4.10 shows the line of non-isolated critical points. Away from the line of 
equilibria, the two differential equations are proportional we can divide them 


to obtain 
dy  cu+dy _ 


dx axt+by — 
where m is the constant of proportionality. Thus the orbits are y = mx+C, 
whereC is a constant of integration. These are shown in Figure 4.10 as well. 
These orbits either all approach the line of equilibria or exit the line of equilib- 
rium. To determine which is the case, we can calculate the sign of x2’ = ax + by 


> 


above and below the equilibrium line to determine if x is increasing or decreas- 
ing. A similar calculation could be made for the sign of y’. In a different way, 
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if the nonzero eigenvalue is negative, then all the orbits approach the line of 
equilibria, and if it is positive, they exit the equilibria. 


Figure 4.10 Phase plane diagram in the case det A = 0 and the differential 
equations are proportional with dy/dx = m. The critical points are along the 
line az + by = 0, and the other orbits are straight lines of slope m. Either all 
of the orbits approach the line of equilibria as t + +00 (shown), or all of them 
exit the line of equilibria and go to infinity as t + +oo. In this latter case the 
arrows are reversed from those shown. 


Example 4.35 
Consider the system 
g =x —2y, 
y = —2a + Ay. 
Clearly the equations are proportional and det A = 0. The equilibria are along 
the line y = de. The orbits are found by dividing, 
d —2¢4 +4 
I or y= —2a. 
dx x — 2y 


The characteristic polynomial is A? — 5\ = 0, giving eigenvalues A = 0, 5. 
Therefore the orbits exit the the line of critical points. The phase diagram is 
similar to that in Figure 4.10 with the direction arrows reversed. 


Example 4.36 


(General solution) Consider the system 


o ( ; : )x (4.37) 
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Notice that the coefficient matrix has det A = 0 and so the characteristic 
equation is A? — 5\ = A(A — 5) = 0, giving a zero eigenvalue, A; = 0. This 
always occurs when det A = 0. The other eigenvalue is Ap = 5. When » = 0 
then the eigenvectors are found by solving (A — \J)v = Av = 0, or 


(Ga oeG): 


Again the equations are the same. Taking v1 + 2v2 = 0 gives vy = —2v9; taking 
v2 = 1 gives v; = —2. Therefore an eigenpair is 


a=au=( 7), 


The other eigenpair, left for the reader, is 


r=, v2=( 5). 


A fundamental set of solutions is therefore 


m=( “1 ). ao=(3 er 


and the general solution is 


x=a( 7 )+a(5 


The line of nonisolated critical points is the line in the direction of the eigen- 


vector associated with \ = 0, or x + 2y = 0. There is one linear orbit x(t) 
1 


leading to a pair of opposing rays that exit the origin along the line y = 5 


All other orbits are parallel to the linear orbit with the same directions. 


EXERCISES 


1. Using the following eigenpairs for a given system, write the general solution 
and state the type of critical point and its stability. 


vn(d)a( on (4)2(2) 
vn(aaG) 94204) 


2. Find the general solution of the systems with with the following coefficient 
matrices: 


x. 
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—l 1 —1 1 
») ( 0 a) o) ( 1 ae 
1 0 1 1 
b : d : 
(aa) (98) 
3. Sketch a phase plane diagram for the systems with coefficient matrices 


given in Exercise 2. 


4. Solve the initial value problem 


5. Solve the initial value problem 
ne eae = 2 
x= ( 3 1 )% x(0)=[ i}: 


4.4.2 Complex Eigenvalues 


If the eigenvalues of the matrix A are complex, there are solutions of the form 


The eigenvalues, which are solutions of a quadratic equation, are complex con- 


jugates, A = a + bi. The corresponding eigenvectors are v = w + iz, also 
complex conjugates. Taking the eigenpair a+ bi, w+iz, we obtain the complex 
solution 

(w + iz)eletrot, 


Recalling that the real and imaginary parts of a complex solution are real 
solutions, we expand this complex solution using Euler’s formula to get 


(w + iz)e“e'* = e(w + iz) (cos bt + isin bt) 


= e“(w cos bt — zsin bt) + ie*’(w sin bt + zcos dt). 
Therefore two real, independent solutions are 
x1(t) =e"(wcosbt —zsinbt), xo(t) =e“ (wsin bt + zcosdt), 
and the general solution is a combination of these, 


x(t) = c,e™ (w cos bt — zsin bt) + coe"'(w sin bt + zcos bt). (4.38) 
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In the case of complex eigenvalues we need not consider both eigenpairs; each 
eigenpair leads to the same two independent solutions. For complex eigenvalues 
there are clearly no linear orbits, as you can see from the presence of the oscil- 
latory trigonometric terms. The terms are periodic functions with frequency 
b and period 27/b, and they define orbits that rotate around the origin. The 
factor e“ acts as an amplitude factor and causes the rotating orbits to expand 
if a > 0, and thus we obtain expanding spiral orbits going away from the origin. 
If a < 0 the amplitude decays and orbits spiral into the origin. 

In this case, we say the origin is a spiral point. If a < 0, the origin is an 
an asymptotically stable spiral point, and it is an attractor. When a > 0 
the origin is a repeller and we say it is an unstable spiral point. 


Example 4.37 


(Complex eigenvalues) Let 


x= ime x 
~ 3-2 : 


We calculated the eigenvalues and eigenvectors of the coefficient matrix in 
Example 4.28. The eigenvalues are \ = —2+3% with corresponding eigenvectors 
(—1,i)? and (—1,—-i)T. Using \ = —2 + 3% with eigenvector 


(7) 


we get a complex solution. But, using Euler’s formula we can obtain two linearly 
independent real solutions: 


x(t) = ( - joes = ( z. ) +4 ( : )| e (cos 3t + isin 3t) 
a 
_ { —e7*' cos 3t i —e~* sin 3t 
~ \ ~e72' sin 3t *\ 6-2 cos3t )” 
Therefore two linearly independent solutions are 


ee —e- cos 3t ). ie: ~e~% gin 3t 


—e~*' sin 3¢ —e~** cos 3t 


The other complex conjugate eigenpair gives rise to the same two real solutions. 
So, the general solution of the system is a linear combination of these two 
solutions, x(t) = c1x1(t) +.c2x2(t). In the phase plane the orbits are spirals that 
approach the origin as t + +oo because the real part of the eigenvalues, —2, 
is negative. See Figure 4.11. At the point (1,1) the tangent vector is (x’, y’) = 
(—5, 1), so the spirals turn in a counterclockwise manner. In this case the origin 
an asymptotically stable spiral point. 
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Figure 4.11 An asymptotically stable spiral from Example 4.37. 


Purely Imaginary Eigenvalues 


If the eigenvalues of A are purely imaginary, \ = + bi, then the amplitude 
factor e in (4.38) is absent and the solutions are periodic of period 27/b. The 
general solution is 


x(t) = c1(w cos bt — zsin bt) + co(w sin bt + z cos bt). 


The orbits are closed, periodic cycles and plot as concentric ellipses or circles. 
In this case we say the origin is a stable center. Orbits close to the origin 
remain close, but no orbit approaches the origin. 


EXERCISES 


1. Write the general solution of the linear system with the given eigenvalues 
and eigenvectors and express each solution in component form. 


a) Anti, v=( 4), b) A=ie2i, v=( 44, ). 


2. Sketch a phase plane diagram for the system with coefficient matrix 


Ga) 


Include the nullclines (dashed) and sample direction field vectors. 


3. Sketch a phase plane diagram for the system with coefficient matrix 


2) 


Include the nullclines (dashed) and sample direction field vectors. 
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4.4.3 Real, Equal Eigenvalues 


Next suppose the eigenvalues of the coefficient matrix A are real and equal, 
that is, 


and \ # 0. There are two cases. 

In the case that has a pair of independent eigenvectors v; and v2, then 
there are two independent solutions 
IN 


At 


x1(t) = vie Xo(t) = vee 


Therefore the general solutions is 
x(t) = crvie™! + covge™. 


This is a linear combination of two independent linear orbits. 
In the second case, A has a repeated real eigenvalue A with only a single 
eigenvector v. In this case we say the matrix is deficient. Then 


x4 (£) = ve 

is one solution representing opposing linear orbits. However, we need another 
independent solution. An intuitive guess, based on experience with second- 
order equations in Chapter 2, is to take te**v, but that does not work. Try it. 
However, the slightly modified vector function 


x2(t) = e (tv + w), 


does satisfy the differential equation for a some constant vector w to be deter- 
mined. Substituting x2 into the system we get 


x, = ey + Ne (tv + w), 


Ax, =e A(tv + w). 
These are equal and so we obtain an algebraic system for w: 
(A— \I)w =v. (4.39) 


This system always has infinitely many solutions w because det(A — AI) = 0. 
We only need to choose one. The vector w is called a generalized eigenvector 
of A. Therefore we have determined a second linearly independent solution. In 
summary, the general solution to the linear system x’ = Ax in the deficient 
case is 

ay 


x(t) = crve™ + coe! (tv + w), 


where w is a solution to (4.39). 
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If the repeated eigenvalue is negative all the orbits enter the origin as 
t + +00, and they go to infinity as t + —oo. We say the origin is an asymp- 
totically stable node. If the eigenvalue is positive, the orbits reverse direction 
in time and all leave the origin; we say it is an unstable node. In the case 
of equal eigenvalues, the term degenerate node is often used to describe the 
structure, which appears different from a common node where the eigenvalues 
are unequal. 


Example 4.38 


Consider the system 


The characteristic polynomial is \? +4\+4 = 0, which gives equal eigenvalues 
A = —2,—-2. Then, to find the eigenvectors we substitute 4 = 2 into the 
eigenvector equation 


awe (3 3)(2)=(8). 


There is no restriction on v; and v2, other than that both cannot be zero 
simultaneously; thus we can choose them arbitrarily. Take v; = (1,0) and 
v2 = (0,1), which are two independent eigenvectors associated with A = —2. 
This is the non-deficient case. Two independent solutions are 


The components of the general solution are 


z(t)=ce**, y(t) =c2e7**. 


Taking their ratios we get 


y(t) — coe7 C2 


x(t) cyew2* ey’ 


which gives the straight lines y = ao for all c1, cg. These are the orbits for the 
system, all of which are rays, entering the origin as t + +oo. Note that c; = 0 
corresponds to the two opposing vertical orbits on the y axis. These linear orbits 
can also be found by dividing the two original differential equations. 
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Example 4.39 


(Deficient matrix) Consider the system 


The eigenvalues are \ = 3,3 and a corresponding eigenvector is v = (1,1)?. 
Therefore one solution is 
1 
x, (t) = ( 1 es 


Notice that this solution plots as a linear orbit coming out of the origin and 
approaching infinity along the direction (1, 1)™. There is automatically an oppo- 
site orbit coming out of the origin and approaching infinity along the direction 
—(1,1)*. A second independent solution has the form x2 = e*“(tv + w) where 


w satisfies in ; 
(A - 3I)w = ( a! )w= ( 1 ) 
This equation has many solutions, and so we choose 
(a) 
i}. 
Therefore a second solution has the form 


wonewrena[(1)())-( alia) 


The general solution of the system is the linear combination 
x(t) = cx1(t) + coxe(t). 


If we append an initial condition, for example, 


x0)=( 5); 


then we can determine the two constants c; and cg. We have 


x(0) = e1x1(0) +e230(0) = a ( : )+a( : j= ( i : 


cq = 1, Q= —l. 


Hence 
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Therefore the solution to the initial value problem is given by 


2001) 069( ne )=(Sal). 


As time goes forward (t + +00), the orbits go to infinity, and as time goes 
backward (¢ — —oo), the orbits enter the origin. The origin is an unstable 
node. 


EXERCISES 


1. Find the general solution and sketch a phase diagram. 


x= (7 _)e b= (i ae 


2. Plot the solution curve found in Example 4.39 for —2<t< 1. 


4.5 Phase Plane Analysis 


We developed all the tools to completely analyze two-dimensional linear sys- 
tems, both analytically and graphically. In this section we take a broad overview 
of the process and apply it to some practical applications that contain param- 
eters, not merely fixed numerical constants. A complete summary of the pre- 
ceding sections is included in the discussion. 

The analysis has shown that all of the analytic information about systems 
can be obtained by knowing the eigenvalues and eigenvectors of the coefficient 
matrix. The eigenvalues are roots of the characteristic equation (Table 4.1) 


\? — (tr A)A + det A =0 


and are given by 


i (t+ (tr Ay? — Tdet A) 


Nle 
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Table 4.1 Solution properties of the system x’ = Ax in terms of the eigen- 


values in the case det A # 0. 


Figenvalues 
At, A2 > 0, real, unequal 
At, A2 < 0, real, unequal 


Ay <0 < Ag, opposite signs 


A = +bi, purely imaginary 
A=atbi,a>0 
A=atbi,a<0 

Ay = A2 > 0 

Ay = A2 <0 


Orbital Structure 

unstable node 

asymptotically stable node 
unstable saddle 

center; stable ellipses or circles 
unstable spiral 

asymptotically stable spiral 
unstable node 


asymptotically stable node 


These depend only on knowledge of the trace and determinant of the matrix 


A. The following table summarizes the orbital structure and its dependence on 


the eigenvalues. 


The basic types of geometrical structures in the phase plane are shown in 


center | node 
saddle ; 
| spiral 


Figure 4.12 Generic plots of the four basic orbital structures for two- 
dimensional linear systems: center, node, saddle, and spiral, in the case 
det A # 0. Orbital directions are not indicated. If the eigenvalues are equal, 
the node has a different appearance from that shown. 


Figure 4.12. 
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The following theorem summarizes the dependence on the trace and deter- 
minant. 


Theorem 4.40 
Consider the linear system x’ = Ax, where det A 4 0. Then 
e If det A < 0, then (0,0) is a saddle point. 
e If det A> 0 and tr A = 0, then (0,0) is a center. 
e If det A> 0, trA > 0, and 4det A < tr A, then (0,0) is an unstable node. 
e If det A>0trA > 0, and 4det A > tr A, then (0,0) is an unstable spiral. 


e If det A> 0, trA < 0, and 4det A < tr A, then (0,0) is an asymptotically 
stable node. 


e IfdetA > 0 trA < 0, and 4det A > tr A, then (0,0) is an asymptotically 
unstable spiral. 


Figure 4.13 shows the conclusions of the theorem on a plot of det A versus 
tr A. One can compute these two quantities and locate the point on the plot to 
quickly determine the type of structure and its stability. 


4 det A 


centers 
ate 


2 
(tr 4) —4det 4=0 
stable | unstable /. —— 
spirals spirals 


unstable 
nodes 


>trA 


saddle points 
(unstable) 


Figure 4.13 A plot of the regions of the trace-determinant plane where the 
various orbital structures occur. Along the horizontal axis where det A = 0, one 
of the eigenvalues is zero, giving an exceptional case of a line of nonisolated 
equilibria. 


Finally, we summarize our results with the stability theorem for two- 
dimensional linear systems x’ = Ax. 
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Theorem 4.41 


The origin is asymptotically stable if, and only if, 


trA<0O and detA>0O. 


How to Draw a Phase Diagram 


To draw a rough phase diagram for the linear system x’ = Ax, all we 
need to know are the eigenvalues, the eigenvectors, the direction field, and the 
nullclines where the vector field is vertical, or horizontal. 


(a) If the eigenvalues are real and unequal, draw the linear orbits which 
are in the direction of the associated eigenvectors. Label each ray, or linear 
orbit, with an arrow that points toward the origin if the eigenvalue is negative 
and away from the origin if the eigenvalue is positive. Using the direction field, 
fill in the regions between these linear orbits with consistent solution curves, 
paying attention to which “eigen-direction” dominates as t + oo and t + —oo. 
Drawing nullclines refines the orbital plots. 


(b) If the eigenvalues are purely imaginary then the orbits are closed ellipses 
around the origin. Compute a direction field vector to determine if the orbits 
are clockwise or counterclockwise. Draw in the nullclines to obtain the fine 
detail where the closed orbits are vertical or horizontal. 


(c) If the eigenvalues are complex then the orbits are spirals. If the real 
part of the eigenvalues is negative, they spiral in; if the real part is positive, 
they spiral out. Compute a direction field vector to determine if the spirals 
are clockwise or counterclockwise and draw in the nullclines to obtain the finer 
detail. 


(d) If zero is an eigenvalue (det A = 0) there is a line of equilibria or critical 
points along az + by = 0. Divide the differential equations and solve to find 
the orbits, which are straight lines approaching the equilibria or exiting the 
equilibria. 


The next four examples illustrate classical applications of linear systems 
and how to analyze them geometrically. 


Example 4.42 


(Crop-Soil Model) In this example we return to the crop-soil compartmen- 
tal model introduced in Section 4.1 (see Example 4.2). Figure 4.14 indicates 
the flow rates between the two compartments. If « = 2(t) is the amount of 
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Figure 4.14 A compartmental diagram showing the exchange rates of the 
herbicide between crops and the soil. The —yy term represents the degradation, 
or decay, rate in the soil. 


pesticide in the crop, and y = y(t) is the amount in the soil, we obtained a 
two-dimensional system with unknowns x(t) and y(t): 


dx 

a PO 
dy 

a Ba —(a+y)y 


The coefficient matrix is 


A= ( a ) 
B —(at+¥7) 
Dividing these equations leads to a difficult differential equation or x and y, 
which we want to avoid. Also, finding the general solution in terms of eigenval- 
ues and eigenvectors of A involves many cases because all we know is that the 
parameters are positive. Therefore, a geometric, or qualitative, approach is a 
good strategy to find the behavior of the system. 

Setting both equations equal to zero shows that the only critical point is the 
origin, x = y = 0. Because x and y are nonnegative, only the first quadrant is 
relevant. To get an indication of the direction field we plot the x nullcline where 
xz’ = 0, or —Gx+ay = 0. The vector field is vertical this line so orbits must cross 
vertically. Next we plot the y nullcline where y’ = 0 or Ba —(a+7)y = 0. The 
vector field is horizontal along that line, so orbits cross horizontally. Therefore, 
the « and y nullclines are the straight lines 


y= a (a-nullcline); y= x (y-nullcline). 
a 


a+y 

The nullclines are dashed lines in Figure 4.15. The x-nullcline has greater slope 
than the y-nullcline. In the three regions bounded by the nullclines we can 
calculate the direction of the vector field. For example, x’ = ay — Bx > 0 
whenever y > (G/a)z, and 2’ = ay — Bx < 0 whenever y < (3/a)x. Similarly, 
y = Bu —(a+~7)y > 0 whenever y < (G/(a+7))a, and y’ = Bx—(a+y)y <0 
whenever y < (3/(a+7))a. Putting this information together in a single plot, 
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we see that the vector field points southeast in the top most region, southwest 
in the region between the nullclines, and northwest in the lower region. 

Figure 4.16 (right panel) shows the behavior of the orbits as determined by 
the vector field. It is clear that the origin is an asymptotically stable node. This 
means the pesticide eventually disappears from the system. A corresponding 
time series plot for the lower orbit in the left panel confirms that the pesticide 
concentrations in both the plants and the soil eventually decay to zero. 

To confirm these results analytically, we compute tr A = —(a+6+~7) <0 
and det A = 8(a+ y) — a8 = By > 0. Therefore, by Theorem 4.41, the origin 
is asymptotically stable. Therefore it is a node or spiral point. By our diagram 
it is a node because the vector field has no rotation. 

In summary, we analyzed this problem geometrically using the direction 
field without solving the equations at all. Often this is all we want from a 
model. 


/ 


Figure 4.15 The xz-nullcline (z’ = 0) and the y-nullcline (y’ = 0) shown 
dashed; note that the y-nullcline is below the x-nullcline. In the three regions 
bounded by the nullclines the direction field is indicated. 


/ 


Example 4.43 


We give an example of sketching the phase diagram using chiefly geometric 
methods. Consider 


x’ = —Tx + by, 
y = 6x + 2y. 


Immediately we see det A < 0 and therefore (0,0) is a saddle point. To get 
the fine detail we plot the nullclines. We have 2’ = 0 on y = —(7/6)a 
(x-nullcline), and y’ = 0 on y = —3a (y-nullcline). See Figure 4.17. There 
are 4 regions bounded by the nullclines. In each region we choose a point and 
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Figure 4.16 (Left) The orbits, as determined by the direction field in Fig- 
ure 4.15. (Right) A sample time series plot corresponding to the lower orbit 
(right) in Figure 4.15. 


find the direction field in the entire region. For example, take the point (0, 1) 
on the positive y axis; the direction field is (2’, y’) = (6,2), which is northeast, 
and it has a NE direction in the entire region. The direction field in the other 3 
regions is shown in the figure. Using knowledge that (0,0) is a saddle point, we 
can place four key orbits on the phase diagram to indicate the flow. We know 
there are 4 rays, or separatrices, that separate the types of orbits. We cannot 
know the exact directions of these rays unless we compute the eigenvectors. The 
separatrices entering the origin are associated with the negative eigenvalue, and 
the separatrices exiting the origin are associated with the positive eigenvalue. 


Example 4.44 


(Glucose—Insulin Interaction) When an individual consumes food, espe- 
cially carbohydrates, the pancreas responds by producing insulin, the key hor- 
mone that unlocks cell receptors on the cell walls to inject the glucose into 
the cell. If « denotes the excess amount of glucose in the blood above some 
equilibrium amount, and y denotes the excess amount of insulin, then a very 
simplified model of the dynamics of the interaction is 


x =—gu—ry, 


y’ = sx —dy, 

where g is the natural decay rate of glucose (e.g., in excretion), r is the rate that 
insulin decreases the glucose, s is the rate that insulin production is stimulated 
by the presence of glucose, and d is the natural decay rate of insulin. The 
constants are positive. (Note that x or y may be negative if the amounts are 
below equilibrium values.) Representative experimental values are 
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Figure 4.17 The z-nullclines (2’ = 0) and the y-nullcline (y’ = 0) shown 
dashed. In the 4 regions bounded by the nullclines the direction field is indi- 
cated. Approximate separatrices are drawn in to in to indicate the linear orbits 
or separatrices. 


g=2.9, r=43, s=0.21, d=0.78. (4.40) 


The origin is the only equilibrium because det A = (—g)(—d) — s(—r) > 0. 
The x nullcline, y = —(g/r)x, where the direction field is vertical, has negative 
slope, and the y nullcline, y = (s/d)x, where the direction field is horizontal, 
has positive slope. See Figure 4.18. In the 4 regions bounded by the nullclines 
the direction field is easily determined and shown in the figure. For example, 
x > Oif y < —(g/r)a, or underneath the z nullcline; and a’ < Oify > —(g/r)a, 
or above the x nullcline. From these simple ideas we can get a rough idea of the 
shapes of the orbits. There appears to be a counterclockwise rotation, which 
may mean a spiral or center; or, the orbits could just veer into the origin, 
making it a stable node. We must work harder to determine which is true. 
The characteristic equation is 


\? — (tr A)\ + det A = \? + (g + d)A + (rs + dg) =0, 


which gives the eigenvalues 


r=5 (Ota (G+ d)? —A(rs + dy) ) 


= 5 (-(9 +4) + V/(g —d)? —4rs) F 
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Figure 4.18 Glucose-insulin dynamics. The nullclines and direction field are 
shown. A typical orbit beginning at (x,y) = (a,0) at time t = 0 is shown for 
the case of a node, which occurs when (g—d)? > 4rs. The system admits stable 
spirals when (g + d)? < 4rs. 


Different cases can occur for different values of the parameters. First, notice that 
tr A < 0 and det A > 0, so the origin is asymptotically stable. Therefore, there 
can be no purely oscillatory solutions where the origin is a center. If (g—d)? < 
4rs, the roots are complex with negative real part, and we obtain decaying 
oscillations, or a stable spiral. If (g — d)? > 4rs, then the roots are real and 
negative, giving a stable node. Stable spirals occur when rs is large, meaning 
there is an excessive insulin response to the glucose, causing a hypoglycemic 
individual’s excess glucose to overshoot and become negative. The reader is 
asked in an exercise to determine the solution for the parameters given in 
(4.40). 


Example 4.45 


(Circuits) Electrical circuits provide important examples of linear systems. 
Figure 4.19 shows a circuit with two loops, and the current in the three sections 
is shown. Their directions can be chosen arbitrarily as long as we are consistent 
in setting up the circuit equations. At any node (say n) the sum of the currents 
entering the node must equal the sum of the currents leaving the node. In this 
case, 

I + Ip = Ts. 


Notice the same equation holds at the opposite node. Now we apply Kirchhoff’s 
law in each loop. There are no voltage sources, or emfs. If we traverse the top 
loop in a clockwise direction, then the sum of the voltage drops across each 
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Figure 4.19 A two-loop circuit with a capacitor, resistor, and inductor. The 
direction of currents is shown. 


element is zero, or 
1 
—Q —-— RIh=0 
ae 2=0, 


where Q is the charge on the capacitor, and Q’ = I,. The negative sign occurs 
because we are traversing the resistor in the opposite direction of the given 
current. In the lower loop, again clockwise, Kirchhoff’s law gives 


RIp + LI, =0. 


It always takes some effort to reduce the equations to a linear system. Here we 
can easily eliminate J, which is 1, = I3 — Ig. Differentiating the equation for 
the first loop gives 


1 1 
Gh — Rh = 0, or alls — h)— RL = 0. 


Solving the last two equations for the derivatives gives a linear system for Ig 
and Ts, 


1 
| eee (ay ee 
2 Ro! 2+ Is), 
R 
| nes 
3 L 


Therefore the coefficient matrix is 


bs 
| 
oS 
1! 
naa|- 
oAl- 
Sa 
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Easily, tr A = —z— < 0 and det A = zy > 0. Thus the origin is asymptotically 
stable. We note that (tr A)? — 4det A = tay — te. Therefore: 


L 
(a) if RG >A4 then (0,0) a node 


L 
(b) if Ro < 4 then (0,0) a spiral 


Figure 4.20 shows a typical orbit in the case of a spiral point. 


| 
# 
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Figure 4.20 A typical decaying spiral orbit for the circuit shown in Fig- 
ure 4.19 representing decaying oscillations. 


Example 4.46 


(Chemical tank reactors) Figure 4.21 shows two tanks with equal volumes 
V and equal inflow and outflow volumetric rates qg, in volume per time. We let 
C, = Ci(t) and Cz = C2(t) denote the concentrations (mass per volume) of 
the chemical in each tank. Further, q,; and gz denote the volumetric flow rate 
(volume per time) of the chemical from Tank 1 to Tank 2, and from Tank 2 to 
Tank 1, respectively. The concentration of the chemical entering Tank 1 is cin. 
Note that a volumetric flow rate times a concentration has units of mass per 
time. 

The conservation of mass law (see Chapter 1), which is applied to each 
reactor, is 


d 
—(Total mass in tank) = rate mass flows in — rate mass flows out. 


dt 
Therefore, applying conservation of mass to each reactor we have 
VCy = qein — mCi + 2Ca, 
VCy = mCi — q2C2 — qCa, 
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which is a linear, nonhomogeneous system for C, and C2. If ci, = 0, then the 
system is homogeneous and has the form 


ene Le gee ee 4) 4.41 

p= Cit Ce, (4.41) 
+q 

Gs oF be Cs, 4.42 

ya V L V 2 ( ) 


The coefficient matrix is 


The trace is clearly negative and the determinant (= qiq/V”) is positive. There- 
fore the origin is asymptotically stable. Therefore the concentrations eventually 


go to zero. 


Figure 4.21 Coupled chemical reactors. 


EXERCISES 


1. Find the eigenvalues and eigenvectors of the following matrices: 


so(4 4): 22(7 8): e@(7 4). 


2. Write the general solution of the linear system x’ = Ax if A has eigenpairs 
2, (1,5)" and —3, (2,—4)?. Sketch the linear orbits in the phase plane 
corresponding to these eigenpairs. Find the solution curve that satisfies 
the initial condition x(0) = (0,1)? and plot it in the phase plane. Do the 
same for the initial condition x(0) = (—6, 12)". 


3. Answer the questions in Exercise 2 for a system whose eigenpairs are —6, 
(1,2)? and —1, (1,—-5)?. 


4. For each system find the general solution and sketch the phase portrait. 
Indicate the linear orbits (if any) and the direction of the solution curves. 
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og es a= (93) 
oe= (5) w= (4 )= 
oe=(G 5) ae 
he et) eo. 


5. Solve the initial value problem 


-(4 5) wo-(4) 


6. Consider the system 


a) Find the equilibrium solutions and plot them in the phase plane. 
b) Find the eigenvalues and determine if there are linear orbits. 
c) Find the general solution and plot the phase portrait. 


7. (Bifurcation) Bifurcation theory is the study of how equilibrium solutions 
and their stability properties change as parameters change in a problem. 
In the following system let a@ be a parameter: 


a) Find the general solution when a = 1/2, and classify the critical point. 
b) Repeat if a = 2. 
c) Discuss the behavior of the system when 1/2 < a < 2. 


8. For the following systems: (i) Determine the eigenvalues in terms of a. (ii) 
Find the values of a for which the phase plane changes type. (iii) Sketch a 
typical phase diagram. 


ve(2 3) wee(f 4) 


4.5 
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10. 


11. 


12. 


13. 


14. 


15. 


. Determine the behavior of solutions near the origin for the system 


for different values of the parameter a. 


The matrix for a linear system is 


a J2+a4 /2 
V2—a/2 0 ; 

where —co < a < co. Sketch the path traced out in the trace-determinant 

plane as a varies over its range. Compute the values of a where a bifurcation 

occurs and state what the bifurcation is. 


For the systems in Exercise 4, characterize the origin as to type (node, cen- 
ter, spiral, saddle) and stability (unstable, neutrally stable, asymptotically 
stable). 
Consider the system 

xg = —3x+ ay, 

y’ = bx — 2y. 
Are there values of a and b where the solutions are closed cycles (periodic 
orbits)? 


In the tank reactor setup in Example 4.46, take ci, = 0, g = 15 liters/min, 
qi = 16 liters/min, gg = 1 liter/min, with V = 4 liters. If there is no salt 
in tank 1 and 0.3 oz in tank 2, find the concentrations and sketch a phase 
plane diagram. 


For each of the following nonhomogeneous systems: (a) Find the equilib- 
rium solutions, if any. (b) Find the general solution. (c) Sketch a phase 
diagram. 


x= (4 3 )=+(o) d¥=(5 3 )x+(7) 
mee a)e(G) oes aC) 


Consider the circuit shown in Figure 4.22 with two loops. J; and Iz are the 
currents in the upper and lower loops and Jz is the current in the middle 
segment, with directions as shown. E(t) is the electromotive force. 


a) Apply Kirchhoff’s law in both loops to obtain 


Inf, + Ril — Relg = E(t), L3li + Rolo + Rglz = 0. 
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Figure 4.22 Two-loop circuit. 


b) The sum of the currents entering the node, or junction, n must equal 
the sum of the currents leaving the node. Show 


Ih + Ip = 13. 


c) Eliminate the current from the two equations in part (a) and derive a 
nonhomogeneous linear system for J;, [3. Write the system in standard 
form, identifying the coefficient matrix. 


d) Sketch phases diagrams for each possibility. The diagrams should 
include critical points, nullclines, the direction field, and sample orbits. 


16. Analyze the circuit in Figure 4.23, letting J be the current through the 
inductor and V the voltage across the capacitor. Begin by showing the 
governing equations are 


P=-I-V, V’=2I-V. 


Figure 4.23 circuit. 
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17. A system of the form 
x’ (t) = rAx(t —T), 
where the growth rate at time t depends on the state of the system at an 
earlier time t — T is called a delay equation. Show that the system has a 
solution of the form 
x(t) = ve’ 

provided v is an eigenvector of A (with eigenvalue A). In particular, show 
that o must satisfy the equation 


a=rre 7!” 


Will this equation always have a solution 0? 


4.6 Nonhomogeneous Systems 


Corresponding to a two-dimensional, linear homogeneous system x’ = Ax, we 
now examine the nonhomogeneous system 


x’ = Ax + f (0), (4.43) 


r= (2 ) 


is a prescribed vector function. We think of the function f(t) as the driving 
force, or a source, in the system. In previous sections we examined problems 
with f(t) = b, where b is a constant force. 

To ease the notation in writing the solution of (4.43) we define a funda- 
mental matrix ®(t) as a 2 x 2 matrix whose columns are two independent 


where 


solutions to the associated homogeneous system x’ = Ax. So, the fundamental 
matrix is a square array that holds both vector solutions. It is straightforward 
to show that ®(t) satisfies the matriz equation ®'(t) = A®(t), and that the 
general solution to the homogeneous equation x’ = Ax can is form 


where c = (c1,¢2)* 


is an arbitrary constant vector. (The reader should do 
Exercise 1 presently, which requires verifying these relations.) 

The variation of parameters method introduced in Chapter 2 for nonho- 
mogeneous, second-order equations is applicable to first-order linear systems. 


Therefore we assume a solution to (4.43) of the form 


x(t) = ®(t)e(t), (4.44) 
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where we have “varied” the constant vector c. Then, using the product rule for 
differentiation (which works for matrices), 


x'(t) = ®(t)c'(t) + ®'(t)c(t) = B®(t)e'(t) + A®(t)c(t) 
= Ax + f(t) = A®(t)c(t) + f(t). 


Comparison gives 
@(t)e’(t) =f(t) or c/(t) = O(t)'£(t). 


We can invert the fundamental matrix because its determinant is nonzero, a 
fact that follows from the independence of its columns. Integrating the last 
equation from 0 to ¢ then gives 


c(t) =| &(s)~'f(s)ds +k, 


where k is a arbitrary constant vector. Note that the integral of a vector func- 
tion is defined to be the vector consisting of the integrals of the components. 
Substituting into (4.44) shows that the general solution to the nonhomogeneous 
equation (4.43) is 


x(t) = &(t)k + oy | &(s)~'f£(s)ds. (4.45) 


As is the case for a single first-order linear DE, this formula gives the general 
solution of (4.43) as a sum of the general solution to the homogeneous equation 
(first term) and a particular solution to the nonhomogeneous equation (second 
term). Equation (4.45) is called the variation of parameters formula for 
systems. It is equally valid for systems of any dimension, with appropriate size 
increase in the vectors and matrices. 

It is sometimes a formidable task to calculate the solution (4.45), even in 
the two-dimensional case. It involves finding the two independent solutions 
to the homogeneous equation, forming the fundamental matrix, inverting the 
fundamental matrix, and then integrating. 


Example 4.47 


Consider the nonhomogeneous system 
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The eigenpairs are 1, (1,—1)7 and 3, (—3,1). Therefore two independent 
solutions are 


A fundamental matrix is 


and its inverse is 


54 1 eu. Be 1 ae Se ly ee Se" 
= = eae e ef ~ ae \ ef et ~~ ON e3t e-3t Je 
4 
t 


By the variation of parameters formula (4.45), the general solution is 


ef —3e%* e-* 3e78 0 
——t = d 
x(t) H(t + ( a )f e735 p38 ) ( % ) 2 


1 eb —3e%# 
= &(t)k — 2 ( _et est ) 
1 et —3e3* 3 [* se-Sds 
= O(t)k — = 0 
(t) 2 ( _et est ) ( fo se7*ds 
1 eb —3e%# 3—3(t+1)e* 
= 908-3 Be) Grane 
+ 


ky ef =. 3kpe%# t 

i ( —kyet + ke ) uy ( —2t-3 ). 

If the nonhomogeneous term f(t) is relatively simple, we can use the method 

of undetermined coefficients (judicious guessing) introduced for second-order 

equations in Chapter 2 to find the particular solution. In this case we guess the 

trial form of a particular solution, depending upon the form of f(t). For exam- 

ple, if both components are polynomials, then we guess a particular solution 

with both components being polynomials that have the highest degree that 
appears. 


Example 4.48 
If 


a aca 


then a guess for the particular solution would be 


24 
x,(t) = ( aes ). 


aot? 7 bot + C2 
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Substitution into the nonhomogeneous system then determines the six con- 
stants. 


Generally, if a term appears in one component of f(t), then the guess must 
have that term appear in all its components. The method is successful on forcing 
terms with sines, cosines, polynomials, exponentials, and products and sums of 
those. The rules are the same as for single equations. But the calculations are 
tedious and a computer algebra system is often preferred. 


Example 4.49 


We use the method of undetermined coefficients to find a particular solution 
to the equation in Example 4.47. The forcing function is 


0 
t ? 
and therefore we guess a particular solution of the form 
es at+b 
P \ ct+d }° 
Substituting into the original system yields 
a\_ 4 3 at + b “ 0 
ec} \-1 0 ct+d t f° 
Simplifying leads to the two equations 


a = (4a + 3c)t + 4b + 3d, 
c=-—b+(l-a)bt. 


Comparing coefficients gives 


a=1, b=-c=-=, d=-—. 


Therefore a particular solution is 
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EXERCISES 


1. Let 
or(t) ) ( v(t) ) 
xX, = , Xo = 
( a(t) * \ dalt) 
be independent solutions to the homogeneous equation x’ = Ax, and let 


_{ gilt) aft) 
a0) -( d2(t) a(t) ) 


be a fundamental matrix. Show, by direct calculation and comparison of 
entries, that ®’(t) = A®(t). Show that the general solution of the homoge- 
neous system can be written equivalently as 


x(t) = C1X1 + CoX2 = (t)c, 
where ¢ = (ci, €2)" is an arbitrary constant vector. 


2. Two lakes of volume V; and V2 initially have no contamination. A toxic 
chemical flows into lake 1 at g+r gallons per minute with a concentration 
c grams per gallon. From lake 1 the mixed solution flows into lake 2 at q 
gallons per minute, and it simultaneously flows out into a drainage ditch 
at r gallons per minute. In lake 2 the the chemical mixture flows out at q 
gallons per minute. (a) If x and y denote the concentrations of the chemi- 
cal in lake 1 and lake 2, respectively, set up an initial value problem whose 
solution would give these two concentrations (draw a compartmental dia- 
gram). (b) What are the equilibrium concentrations in the lakes, if any? 
Find x(t) and y(t). (c) Now change the problem by assuming the initial 
concentration in lake 1 is x9 and fresh water flows in. Write the initial value 
problem and qualitatively, without solving, describe the dynamics of this 
problem using eigenvalues. 


3. Solve the initial value problem 
Ge Ne nk Be BN 1 nO \. 7 I 
Tae ee ae | 1 y 2)? y(0) J} \ 2 


oe ee ere 
e= 
( t ae 


is a fundamental matrix. 
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Consider the nonhomogeneous equation 


gs —5 3 sec et 
7 2 -10 0 /}° 
Find the fundamental matrix and its inverse. Find a particular solution to 


the system and the general solution. 


Consider the nonhomogeneous equation 


Re 0 1 0 . 
oe >) ( cosue ): Re 


Find the fundamental matrix and its inverse. Find a particular solution to 


TT 
HK 


the system and the general solution. 


Consider the system 
vw =3x4+2y+3, yi =7r4+ 5y4 2b. 


(a) Find the fundamental matrix. (b) Use undetermined coefficients to 
find a particular solution. 


Find the fundamental matrix for the system 


ve =x—3y, y =3r4+7y. 


In pharmaceutical studies it is important to model and track concentrations 
of chemicals and drugs in the blood and in the body tissues. Let x and y 
denote the amounts (in milligrams) of a certain drug in the blood and in the 
tissues, respectively. Assume that the drug in the blood is taken up by the 
tissues at rate r;x and is returned to the blood from the tissues at rate roy. 
At the same time the drug amount in the blood is continuously degraded 
by the liver at rate r3z. (a) Show that the model equations governing the 
drug amounts in the blood and tissues are 


gz’ = —T1X —7T3L+72y, 
ih 
Y =e — Tey. 


(b) Find the critical points in x, y > 0. (c) Find and sketch the nullclines. 
(d) By determining the vector field in regions bounded by the nullclines, 
argue that (0,0) is an asymptotically stable node. (e) Confirm analytically 
that (0,0) is asymptotically stable. (f) In the phase plane sketch the orbit 
with initial values 7(0) = xo, y(0) = 0, and interpret the result. 
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9. In the preceding problem assume that the drug is administered intra- 
venously and continuously at a constant rate D. What are the governing 
equations in this case? What is the amount of the drug in the tissues after 
a long time? 


10. An animal species of population P = P(t) has a per capita mortality rate 
m. The animals lay eggs at a rate of b eggs per day, per animal. The eggs 
hatch at a rate proportional to the number of eggs EF = E(t); each hatched 
egg gives rise to a single new animal. 


a) Write the model equations that govern P and E, and carefully describe 
the dynamics of the system in the two cases b > m and b < m. 


b) Modify the model equations if, at the same time, an egg—eating preda- 
tor consumes the eggs at a constant rate of r eggs per day. 


c) Solve the model equations in part (b) when 6 > m, and discuss the 
dynamics. 


11. Derive the variation of parameters formula for the second-order equation 
xv’ +pr'+qxr = f(t) (p, q constant) by transforming the equation to a 
system and using formula (4.45). 


i) 


Nonlinear Systems 


The first four chapters were almost exclusively about linear differential equa- 
tions, both homogeneous and nonhomogeneous. Such equations have a partic- 
ularly nice algebraic structure to their solutions, which makes them solvable. 
Specifically, for both single equations and systems: 


e A homogeneous equation has the property that a constant multiple of a 
solution is a solution and the sum of two solutions is a solution. 


e The general solution to a nonhomogeneous equation is the sum of the gen- 
eral solution to the homogeneous and a particular solution to the nonho- 
mogeneous equation. 


e The general solution to a homogeneous equation with constant coefficients 
can be found exactly with a formula. 


For nonlinear systems, none of these properties is true. Nonlinear equations can 
rarely be solved by an analytic method. This is unfortunate because Nature 
often acts in a nonlinear way, and most of the models we face in applications 
are nonlinear. 

In this chapter we take up a study of nonlinear phenomena. In spite of the 
lack of analytic solutions, we can develop tools that help analyze such prob- 
lems. The methods are often geometric in nature and they take advantage of 
the local behavior of the equations, which in many cases is almost linear. Non- 
linear analysis applied to differential equations is one of the most challenging 
and interesting endeavors in pure and applied science and engineering. The 
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applications in this chapter include nonlinear mechanics, population ecology, 
epidemiology, chemical reactions, and nonlinear circuits. 


5.1 Linearization 


For motivation we revisit (see Chapter 1) the ideas of the phase line, equilibria, 
and stability for the single, nonlinear autonomous equation 


x’ = f(x). 


An equilibrium x(t) = x. is a constant solution and therefore satisfies the 
algebraic equation f(x.) = 0. We also refer to x. as a critical point. To study 
the behavior near the equilibrium we impose a small perturbation u = u(E) 
on the equilibrium state; that is, we move away from the equilibrium a small 
amount u and then ask if the system returns to equilibrium as time passes, 
or is equilibrium lost. This is the question of stability of the critical point, or 
equilibrium state. Quantitatively, we let 


x(t) =a. + u(t), 


or u(t) = a(t) —2,. Because the perturbation u is small, we we can use Taylor’s 
theorem to study how x(t) changes near x. In particular, from the differential 
equation we have (%. + wu)’ = f(ve + u), or 


w= f(£e) ag f' (e)u + sf" (wee? fee, 


where the dots denote higher-order terms. Neglecting those terms (e.g., if u 
is small, say 0.1, then u? is much smaller, 0.01) we can approximate the last 
equation by 
w= f'(re)u, 

which is a linear differential equation describing how the perturbation u(t) 
evolves near the equilibrium. The constant value f'(a-), the slope of the tangent 
line to the graph of f(z) at x = 2c, is the stability indicator. Clearly the solution 
to the perturbation equation is 


u(t) = u(O)ef (e)*, 
so we get the result from Chapter 1: 
e If f’(x-) < 0, then small perturbations decay and x, is a stable equilibrium. 


e If f’(x-) > 0, then small perturbations grow and x, is an unstable equilib- 
rium. 
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phase line 


phase plane 


Figure 5.1 (Left) Phase line showing an equilibrium and a small perturbation 
u from equilibrium. (Right) The phase plane showing a critical point and a small 
perturbation (u,v). The linearized system dictates how u and v vary near (0,0), 
or how x and y vary near (2¢, Ye). 


If f’(@e) = 0 then we obtain no information about stability, which forces us 
to examine higher order terms in the Taylor series. In summary, the local 
behavior near an equilibrium gives us complete information about the behavior 
of solutions near that point. In this chapter we take exactly the same approach 
for nonlinear systems of equations. 

We consider the nonlinear system 


= f(2,y), (5.1) 
y = 9(2,y), (5.2) 


where f and g are continuously differentiable functions. Let x* = (ae, ye) be 
an isolated equilibrium, or critical point, which means 


f (e, Ye) =0, G(Le; Ye) = 0. 


Thus the critical points represent constant solutions of the system. Now let u = 
u(t) and v = v(t) denote small deviations, or perturbations, from equilibrium. 
That is, take 
a(t) =aet+ult), y(t) = ye + v(t). 

As in the single equation case, to determine if the perturbations grow or decay 
we derive differential equations for the perturbations; how those small changes 
evolve determines the behavior of the orbits near the critical point. Substituting 
into (5.1)—-(5.2) we get the dynamics of the system in terms of u(t) and v(t), or 


ul = f(te + U, Ye + 0); 
uv =Gg(te tu, Ye +). 
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Because the perturbations are small, we can expand the right sides in Taylor 
series about the critical point (r., ye) to obtain 


e = i Ges Ye) Tr fe (Le, Ye)u Te fy (Ze, Ye) eas 
y= G(Xe, Ye) + Gu(Le, Yeu + Iy(Le, Yesv Pere; 


where the dots represent higher-order terms. The first terms on the right sides 
are zero because (2, ye) is an equilibrium, and the higher-order terms are small 
in comparison to the linear terms. Therefore the perturbation equations can be 
approximated locally, or near the critical point, by the linear system 


u = tele; Ye)u Ss SulGes Ye), 
= 9x (Le, Yeu + Jy (Le, Ye), 


near (u,v) = (0,0). This system for the small perturbations, or changes, is 
called the linearized perturbation equations, or simply the linearization of 
(5.1)-(5.2) at the critical point (a, y-). The linearization has a critical point 
at the origin (0,0) corresponding to the critical point (a-, y-) for the nonlinear 
system. In matrix form we can write the linearization as 


( u ) — ( fr (Le; Ye) fy (Ze; Ye) ) ( U ) (5.3) 
vw Jx(Xey Ye) Gy(Le, Ye) ce a 
or, in concise notation, 


where z(t) = (u(t), v(t))?. The matrix J = J(xe, ye) of first partial derivatives 
of f and g defined by 


_ fc(Ze; Ye) fy (Zes Ye) 
J(@e, Ye) 7 ( Gi Gey Ge) Gy (May Yo) ) oa 


is called the Jacobian matrix at the equilibrium (z., y.). Note that the entries 
of this matrix are constants because the partial derivatives are evaluated at the 
equilibrium. We assume that the matrix J does not have a zero eigenvalue, i.e., 
det J # 0. If det J = 0, we must analyze the higher-order terms in the Taylor 
expansions of the right sides of the equations. 

We already know that the nature of the critical point of the linearization 
(5.3) is determined entirely by the eigenvalues of the Jacobian matrix J. Does 
this imply anything about the nonlinear system? The answer is yes, almost all 
of the time. 

There is an important theorem in dynamics that states that near a critical 
point (a., ye) the nonlinear system behaves much like the linearized system at 
the origin (0,0). The only restriction is that the linearized system cannot have 
eigenvalues that are zero or have zero real parts. In one of these exceptional 
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cases the linearized system can have a center, but the nonlinear system has a 
spiral. 

Pictorially, in the non-exceptional cases, the nonlinear system has a slightly 
distorted phase diagram from that of its linearization; the distortion is caused 
by the fact that small terms were deleted to obtain the linearization. Rather 
than formally state a technical theorem, we summarize the key results as fol- 
lows. 


Behavior near a critical point: 


e If (0,0) is asymptotically stable for the linearization (5.3), then a pertur- 
bation decays and (#¢, ye) is asymptotically stable for the nonlinear system 
(5.1)—-(5.2). This occurs when J has negative eigenvalues, or complex eigen- 
values with negative real part. The conditions for asymptotic stability 
are 

tr J(%e, Ye) <0 and det J(xe, ye) > 0. (5.5) 


We use this result often in analyzing nonlinear systems. 


e If (0,0) is unstable for the linearization (5.3), then some or all of the pertur- 
bations grow and (2¢, ye) is unstable for the nonlinear system (5.1)—(5.2). 
This occurs when J has a positive eigenvalue or complex eigenvalues with 
positive real part. 


e The exceptional case for stability is that of a center. If (0,0) is a center 
for the linearization (5.3), then (xe, ye) may be a center or a spiral (stable 
or unstable) for the nonlinear system (5.1)—(5.2). This case occurs when J 
has purely imaginary eigenvalues. 


e In the borderline case of equal eigenvalues, the nonlinear system maintains 
its stability or instability, but the local behavior of orbits may change 
because of inclusion of the nonlinear terms. For example, a node for the 
linearized system may change into spiral for the nonlinear system, but 
stability will not be affected. 


Most of the time we are only interested in whether an equilibrium is asymp- 
totically stable or unstable. This can be determined by examining the trace of 
J and the determinant of J at the equilibrium, as stated in condition (5.5). 


Nullclines. To sketch the phase diagram, it is important to plot the set of 
points where the vector field is vertical; this is the set of points (x,y) where 


2 = f(2,9) =0 (x nullclines). 


The curves where this occurs are called x nullclines. The y nullclines are the 
the points where the vector field is horizontal, or 


y' =g(t,y)=0 — (y nullclines). 
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Observe that x and y nullclines intersect at a critical point, where the vector 
field vanishes. 

One can use computer algebra systems or calculators to draw phase plane 
diagrams. With computer algebra systems there are two options. You can write 
a program, or code, to numerically solve and plot the solutions, or you can use 
their built-in programs that plot solutions automatically. See Chapter 6. 


Sketching the phase diagram 


In summary, we have developed a set of tools to analyze nonlinear sys- 
tems. We can systematically follow the steps below to obtain a complete phase 
diagram. 


1. Find the critical points and check their type and stability by examining 
the eigenvalues of the Jacobian matrix J of the linearized system. 


2. Draw the x and y nullclines. 


3. Using the differential equations, find the direction of the vector field in 
the regions bounded by the nullclines. The directions can be described by 
actual geographical directions: NE, SE, SW, NW. 


4. Sketch in representative orbits from the information above. 


5. To get more detail, find directions of the separatrices (if any) at equilibria; 
these directions are indicated by the direction of the eigenvectors of the 
linearization J. Both saddle points and nodes have separatrices. 


6. In some simple cases, divide the equations and integrate to find the orbits 
in terms of x and y (this may be impossible in most cases). 


7. Use a software package or graphing calculator to obtain an accurate phase 
diagram with actual orbits. 


Example 5.1 
Consider the system 
a’ = f(x,y) =—a+ zy (5.6) 
y' = g(x,y) = —4y + Bay. 
To find the critical points we solve the two equations 
—x£+ay=0, —4y+ 8ry = 0, 
simultaneously. Both factor and we obtain 


x(-1+y)=0, 4y(—1+ 22) =0. 
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The first equation gives x = 0 or y = 1. This give two cases. Substituting « = 0 
into the second equation we get y = 0. Therefore x = 0, y = 0 is a critical 
point. Next, if y = 1, then the second equation gives x = 3, leading to the 
critical point x = 4, y = 1. There are two critical points, 


1 
critical points: (0,0), (5. 1) ; 


Now we calculate the Jacobian matrix at each point. In general, 


| ml a eae) 


Evaluating at the critical point (0,0), 


-1 O 
10,0) = ( 0 a) 
This is a diagonal matrix so its eigenvalues are on the diagonal: \ = —1, —4. 


[Or, we could solve the characteristic equation, A? +5 +4 = 0.] Therefore the 
critical point (0,0) is an asymptotically stable node. Evaluating J at the critical 


point (4,1), we get 
1 0 4 
7) = 2 |. 
“G)=(3 3) 


The characteristic equation is A? — 4 = 0, giving eigenvalues \ = +2. These are 


real with opposite signs, so the critical point (5, 1) is an unstable saddle point. 

There is often a lot of flexibility in sketching the phase diagram. We could 
find the eigenvector directions for each eigenvalue; these indicate the directions 
of the separatrices. Or, we can proceed graphically by sketching the nullclines 
and direction field. 

Let us do the latter. Refer to Figure 5.2. The 2-nullclines are where f(x,y) = 
x(—1+y) = 0, or along the two lines x = 0 and y = 1. Along those lines the 
vector field points up or down. The y-nullclines are where g(x,y) = 4y(—1 + 
2x) = 0, or along the lines y = 0 and x = 3. Along these lines the vector field is 
left or right. Observe, the intersections of the vertical and horizontal nullclines 
are critical points. 

Next let’s put directions on the vector field along the nullclines. On the 
x nullcline (y axis) we have wv’ = 0, y’ = —4y. So y’ < 0 when y > 0, and 
y’ > 0 when y < 0. So, on the positive y axis the arrows are down, and on 
the negative y axis the arrows are up. This means that both the positive and 
negative y axes are orbits approaching the origin. A similar argument can be 
made on the x axis, which is a y nullcline; it shows that the negative x axis is 
an orbit that enters the origin from the left and the positive x axis is an orbit 
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Figure 5.2 First steps in constructing a phase diagram. Locate the critical 
points, which are at intersections of nullclines; use the Jacobian matrix to 
determine the type and stability of the critical points; put directions on the 
nullclines and in the regions bounded by the nullclines. 


entering the origin from the right. The directions along the other nullclines are 
easily calculated and are shown it Figure 5.2. 

The next task it to compute the direction field in the regions bounded by 
all the nullclines. For example, at (1,—1), a point in the 4th quadrant, the 
vector field evaluates to x’ = —2, y’ = —4, which is SW, as indicated. We can 
continue this process with the other regions, but because we know (0,0) is a 
stable node and (5, 1) is a saddle, we can easily guess those directions to get a 
consistent diagram, noting that orbits cannot crash into each other, and they 
cannot change direction unless they cross a nullcline. Moreover, we know that 
a saddle point has separatrices in the direction of the eigenvectors of J at that 
point, and we can approximate where they fit. Recall that for linear systems 
separatrices are linear orbits; for nonlinear systems they are distorted. We leave 
it to the reader to sketch in some key orbits. 


Example 5.2 


Consider the decoupled nonlinear system 


g=g—2?, yf = 2y. 


The equilibria are (0,0) and (+1,0). The Jacobian matrix at an arbitrary (2, y) 


© ten (209 BEB) 8): 
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Figure 5.3. Phase diagram for the system x’ = x — x, y’ = 2y generated 
by software. In the upper half-plane the orbits are moving upward, and in the 
lower half-plane they are moving downward. 


Therefore 


10,0) = ( j ay 


which has eigenvalues 1 and 2. Thus (0,0) is an unstable node. Next 


10,0)= (“4 ay H-1,0)= (7 a. 


and both have eigenvalues —2 and 2. Therefore (1,0) and (—1,0) are saddle 
points. The phase diagram is easy to draw. The vertical (where x’ = 0) null- 
clines are « = 0, # = 1, and # = —1, and the horizontal (where y’ = 0) nullcline 
is y = 0, or the x-axis. Along the x axis we have x’ > 0 if -1 < x < 1, and 
x’ < Oif |z| > 1. The phase portrait is shown in Figure 5.3. 


Example 5.3 
Consider the simple nonlinear system 


z= y? (5.8) 


y 


y = ~<s. (5.9) 
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Clearly, the origin x = 0, y = 0, is the only critical point. The Jacobian 
matrix at the origin is easily 


This has determinant equal to zero, and both eigenvalues are zero. The lin- 
earization procedure does not apply, so we proceed with a different strategy. 
In this case we can divide the two equations and separate variables to get 


3y2dy = —2x dz. 


Integrating gives 
y? = —27 +. 


Rearranging, 
y= (Ca), 


We have obtained the orbits for system (5.8)—(5.9) in terms of a and y, losing 
the dependence on time. These are easily plotted, e.g., on a calculator, for 
different values of C’, and several are shown in Figure 5.4. Note that the x 
axis (y = 0) is a x-nullcline (vertical vector field) and the y axis (7 = 0) isa 
y-nullcline (horizontal vector field). It is important to notice that the critical 
point is not of the usual type (node, saddle, etc.). Unusual orbital behavior is 
common for nonlinear systems. 


fi 1 1 1 L . L L 1 1 
-1 08 -06 -04 -0.2 i) 0.2 0.4 0.6 0.8 1 
x 


Figure 5.4 Phase diagram for x’ = y?, y’ = —22. Because x’ > 0, all the 
orbits are moving to the right as time increases. The critical point is not of 
standard type. 
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If we want orbits in terms of time t, we can write (5.8) as 
g = y? = (Cc - o?)?/3 


which is a single differential equation for « = x(t). We can separate variables, 
but the result is not very satisfying because we get a complicated integral. 
Components of solutions are not easily obtained for nonlinear problems. How- 
ever, the qualitative behavior shown in the phase diagram is often all we want. 
If we need time series plots, we can obtain them using a numerical method. 


EXERCISES 


1. For each of the following nonlinear systems: (a) Find all the critical points. 
(b) Use the Jacobian matrix to classify the critical points (saddle, node, 
etc., stable, asymptotically stable, etc.) (c) In the phase plane sketch the 
nullclines and indicate the direction field in regions bounded by the null- 
clines. (d) Insofar as possible, sketch a rough phase diagram indicating 
several key orbits. 


a) @ =a-y, y’ =2a(-1+y). d) « =—-2+ay, y = —2y(1—4z). 
b) ae =a2-ay’, y =a2+y. e) e =a-yta’, y =ar+y. 
ce) a =1—-27, y =yt+2. f) —x—2y, y! =2e-—ytay?. 


2. Consider the system 


a’ =x2—ayt+he’, 
/ 


where h is a given parameter. For the following 3 values of h find the critical 
points and classify them as to type and stability: h = —1, 1, 8. 


3. Consider the system 
x =—-l/y, y! =2z. 


a) Are there any equilibrium solutions? 
b) Sketch the nullclines and vector field. 


c) Find a relationship between x and y that holds on orbits, and plot 
several orbits in the phase plane. 


4. Consider the nonlinear system x’ = x? + y? — 4, y! = y— 22. 


a) Find the two equilibria and plot them in the phase plane. 
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b) On the plot in part (a), sketch the nullclines. 


c) Indicate the direction of the vector field in the regions separated by 
nullclines. Can you determine the nature (node, center, etc.) and sta- 
bility of the equilibria only from this information? 


5. Repeat parts (a), (b), and (c) of the previous problems for the nonlinear 
system z’ =y+1,y =yt+27. 


6. Find all equilibria for the system a’ = siny, y’ = 2a. 
7. Consider the nonlinear system x’ = x? — y?, y’ =x—y. 
a) Find and plot the equilibria in the phase plane. Are they isolated? 


b) Show that orbits are given by x + y+ 1 = Ce”, where C is a constant. 
Plot a few of these orbits. Hint: Determine dy/dz. 


c) Sketch nullclines and the vector field in regions bounded by the null- 
clines. 


d) Describe the fate of the orbit that begins at (4,0) at t = 0 as t + +00 
and as t + —oo. 


e) Draw a phase plane diagram, being sure to indicate the directions of 
the orbits. 


8. Find the equation of the orbits of the system 2’ = e? — 1, y’ = ye” and 
plot the the orbits in phase plane. 


9. Write an equation for the orbits of the system wv’ = y, y’ = 2y+ xy. Sketch 
the phase diagram. 


10. For the following system find the equilibria, sketch the nullclines and the 
direction of the flow along the nullclines, and sketch the phase diagram: 


a =y—x2*, y =2e-y. 
What happens to the orbit beginning at (1,3/2) as t > +00? 


11. Consider the system 


goa =) — xy, 


y=y € -¥) — 27y. 


Find the equilibria and sketch the nullclines. Use the Jacobian matrix to 
determine the type and stability of each equilibrium point and sketch the 
phase diagram. 
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12. Completely analyze the nonlinear system 
vay, yo =a —-1—-y. 
13. Consider the system 


gz = ty — 22° 
y =a —y. 
Find the equilibria and use the Jacobian matrix to determine their types 


and stability. Draw the nullclines and indicate on those lines the direction 
of the vector field. Draw a phase diagram. 


14. Show that the origin is asymptotically stable for the system 


15. Consider the system 


v=Y, 
y =-r-y’. 


Show that the origin for the linearized system is a center, while for the 
nonlinear system the origin is asymptotically stable. Hint: Show that 
(d/dt)(x? + y?) <0. 


5.2 Nonlinear Mechanics 


In this section we take up one of the most important and familiar applications 
of nonlinear systems theory, namely nonlinear mechanics. The techniques in 
the previous section apply, and we introduce new insights that yield the phase 
diagram with little effort, especially for conservative systems. 

The general form of Newton’s law for a particle of mass m moving in on a 
straight line, the « axis, under the influence of an external force F is 


hee ee ae (5.10) 


where x = z(t) is the position of the particle. We assume the force does not 
depend explicitly on time, which makes the problem autonomous. If we let 
y =’ denote the velocity of the particle, then we immediately get the system 


a SU, (5.11) 


— ~ F (2,9). (5.12) 
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We can make some instant conclusions regarding equilibria. For the sys- 
tem (5.11—5.12) the critical points are determined by solving the simultaneous 
equations 

y=0, F(x,0) =0. 

Hence, they are points (a-, 0) on the x axis in the phase plane where F'(2-, 0) = 
0. Clearly, an equilibrium occurs if the force on the particle is zero, with zero 
velocity. In the phase plane the x component of the vector field satisfies x’ = y, 
so the particle moves to the right in the upper half plane, and to the left in the 
lower half-plane. The x axis is an x-nullcline with direction up or down. All 
vertical lines x = 2, are y nullclines with direction to the right in the upper 
half plane, and to the left in the lower half plane. Therefore, much of the phase 
diagram is known, and all that remains is to find the nature and stability of 
the equilibria, and the linearization procedure can often resolve that. 

Conservative forces, where F' depends only on 2, are the simplest and there 
is a particularly easy way to plot the phase plane orbits from the conservation 
of energy equation. 


Example 5.4 


(Conservative systems) We recall from calculus that F' = F(x) is a conser- 
vative force if there exists a potential function V = V(x) for which® 


In words, the force is the negative gradient of the potential. Therefore the poten- 
tial is given by 
V(x) = — | Fleas +C. 


The arbitrary constant C is often fixed so that the potential at x = 0 is zero, 
or V(0) = 0, or sometimes V(+co) = 0. 
If we divide the governing equations, (5.11—5.12) and separate variables, we 
obtain 
mydy = F(ax)dz. 


Integrating both sides leads to 


1 
5my — [Fede +H=-V(a)+8, 
where FE is a constant of integration, denoting total energy. Therefore 
1 
5my +V(c)=E, (5.13) 


8 Occasionally we write dV/dzx as V'(x). The “prime” is understood as an x derivative 
because it is the independent variable; note that x’ means a time derivative. 
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which is the energy conservation law: the kinetic plus potential energy for 
a conservative system is constant. The constant E represents the total energy 
in the system, and it can be computed from knowledge of the initial position 
x(0) = 2 and initial velocity y(0) = yo; that is, 


1 


The conservation of energy law is a reduction of Newton’s second law; the 
latter is a second-order equation, whereas (5.13) is a first-order equation. If we 
replace the position y by dx/dt it may be recast into 


dx 2 
7 [2 VE —V(z). (5.14) 


This equation is separable, and its solution defines the displacement x« = x(t) 
implicitly. The appropriate sign (+) is taken depending on whether the velocity 


is positive or negative during a certain phase of the motion. Integrating (5.14) 
gives the implicit solution 


t=a/% [Sete (5.15) 


For oscillatory motion, this formula is useful in obtaining an expression for the 


period of the motion by integrating over some portion of a period, depending 
on the symmetry of the orbit. 

We can analyze conservative systems qualitatively and simply in the xy 
phase plane by plotting y versus x from equation (5.13) for different values 
of the parameter E. This one-parameter family of curves are the orbits of the 
system, each one representing a constant energy curve. Specifying the initial 
condition determines the F value and picks out the curve with that total energy. 


Example 5.5 


(Oscillator) Consider a spring—mass system without damping. The governing 
equation is 
ma” = —ka, 


where k is the spring constant. The force is —ka and the potential energy V () 
is given by 
k 
V(x) = — | bea = ae 


We have picked the constant of integration to be zero, which automatically 
sets the zero level of potential energy at x = 0 (ie., V(0) = 0). Conservation 
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of energy is expressed by (5.13), or 


1 k 
sry + 57 =H, 


which plots as a family of concentric ellipses in the xy phase plane, one ellipse for 
each value of E. See Figure 5.5. Each curve, along which energy is conserved, 


ZO SS 


sat — 


Figure 5.5 Elliptical orbits smy? + ky? = F for different values of the energy 
FE. The direction of the orbits in each quadrant is shown; they are traced out 
clockwise because x’ = y > 0, or x increases in the upper half plane. Similarly, 
x decreases along the orbit in the lower half-plane. 


represents an oscillation, and the mass tracks on one of these orbits in the 
phase plane, continually cycling as time passes, in the clockwise direction. This 
is because x’ = y, so x increases when y is positive (in the upper half-plane) 
and decreases when y is negative (in the lower half-plane). Clearly, the position 
and velocity cycle back and forth. 
Generally, the conservation of energy curves (orbits) can be obtained graph- 
ically in a simple way. Solving the conservation equation 
1 


k 
2 2 
=my? + —2? =E 
2 2 


2 1 
y =+4/—)/E -— =ka?. 
m 2 


Then, a calculator can be used for the plot. Or, it can be found graphically as 


follows. Simply plot the potential energy function V(x) = $ka? and line y = E 


of constant energy on the same axes (energy vs. x); then subtract graphically 
the square root of the difference E — V(x) of the two to obtain the shape of 


for y gives 
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the upper branch of the elliptical orbit, which is plotted in xy phase space. 
Reflect that half orbit through the x axis to get the lower branch of the ellipse. 
Figure 5.6 illustrates this procedure. To obtain additional orbits, take different 
constant energy levels E. 


Figure 5.6 Graphical method to plot y = ,/2/m,/E — kx?/2. Plot y = E 
and y = ska? (top plot), and approximately subtract the square root of the 


difference, multiplied by the factor ,/2/m, to get the upper branch of the ellipse 
(lower plot). Reflect this curve through the axis to get the lower portion of 
the ellipse. The orbit is counterclockwise since x’ = y > 0 in the upper half 
plane. 


To compute the period T we use (5.15) and integrate over one-fourth of a 
period along the orbit from a point (0, y,z) to the point (#,7,0) through the 
first quadrant to get 


T  [m | aM dx 
4 2 Jo 4/ E — $kx? 
Notice that if yay and EF are given, then xj is determined by the conservation 


law. Then this integral can be computed exactly using elementary calculus. We 
leave this calculation to the reader. 


Example 5.6 


If a particle of mass m = 1 moves on an z-axis under the influence of a nonlinear 
force F(x) = 3x? — 1, then the equations of motion are 

w= y, 

y’ = 3a? — 1. 
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The force depends only on x and thus there is a potential energy function 
given by 
V(a) = - | (30? — Ide = —2? +2 =2(1-—2)(1+2). 
We have taken V(0) = 0. Therefore, conservation of energy is 
1 5 
5! +a(1-—a2)(1l+a2)=E£. 
Solving for the velocity y gives 
y=4tV2J/E—2(1—2)(1+2). (5.16) 
The total energy E can be written in terms of the initial position and velocity 


as E = 4y?(0) + (—2(0)3 + (0)). We can use (5.16) to plot orbits using a 
calculator or computer algebra system. 


energy 


Figure 5.7 A rough geometrical construction of orbits using conservation of 
energy, given the three total energies E, E’, and E” of the system. Compare 
to the exact, computed orbits in Figure 5.8. 
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However, we again illustrate the geometric technique using (5.16) to sketch 
approximate orbits. Refer to Figure 5.7. The potential energy V() is plotted 
as shown and we choose an energy level E. We subtract E — V(x) graphically, 
and then approximately plot y = /2,/E — V(2). This is labeled on the lower 
panel of the plot; we reflected it through the x axis because of the + sign. Thus 
we obtain a single non-periodic orbit as shown, and it is directed to the right for 
y > 0 and to the left for y < 0. Next, we make a similar plot for another special 
value of energy E’ where the maximum potential energy occurs. The resulting 
orbit is in two parts—the closed orbit and the two separatrices, as shown. 
For a still smaller value of energy EF” we obtain a periodic orbit indicating a 
potential well at the minimum of V(x); to the right is a hyperbolic type orbit 
extending from infinity in the 4th quadrant to infinity in the Ist quadrant, both 
approaching the separatrices. So this system can exist in one of two different 
configurations with the same energy, depending on the initial condition. We can 
begin to see that stable center is positioned at the minimum potential energy, 
and a saddle is appearing at the maximum potential energy. This geometrical 
method is sometimes crude, but it can give us a good idea of the dynamics. 

Now let us test the mathematics to verify our intuition. The critical points 


are easily 
1 1 
-,0 —4/-,0]. 
(vie) (Ve) 


fey = ( i ie 


If x = \/1/3 and y = 0 then the eigenvalues \ = +6/V3 (real and opposite 
sign), which signifies a saddle point. If « = -,/1/3 and y = 0 then the eigen- 
values are \ = +6i/./3 (purely imaginary), which is the exceptional case. How- 
ever, the geometrical argument given above shows that (—\/1/3, 0) is indeed a 
center. 

Figure 5.8 shows several orbits computed by software. Let us discuss their 
features. There are two points, x = /1/3, y = 0 and z = —,/1/3, y = 0, 
where x’ = y’ = 0. These are two equilibrium solutions where the velocity 
is zero and the force is zero (so the particle cannot be in motion). These are 
the points where the nullclines cross. The x nullcline is x’ = y = 0, or the y 
axis; there the orbits are vertical. The y nullclines are y’ = 3x? — 1 = 0, or the 
lines 7 = + ef 1S. There, the orbits cross horizontally. The equilibrium solution 
= —4/1/3, y = 0 has the structure of a center, and for initial values close to 
this critical the system will oscillate. The other equilibrium x = ,/1/3, y = 0 
has the structure of a saddle point. Because x’ = y, for y > 0 we have z’ > 0, 
and the orbits are directed to the right in the upper half-plane. For y < 0 we 
have x’ < 0, and the orbits are directed to the left in the lower half-plane. For 


The Jacobian matrix is 
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large initial energies the system does not oscillate but rather goes to x = +00, 
y = +00; that is, the mass moves farther and farther to the right with faster 
speed. 


Figure 5.8 Plots of the constant energy curves $y?+2(1—2x)(1+2) = E in the 
xy-phase plane. These curves are the orbits and show how position and velocity 
relate. Because x’ = y, the orbits are moving to the right (x is increasing) in the 
upper half-plane y > 0, and to the left (x is decreasing) in the lower half-plane 
y <0. This plot was produced using MATLAB®. 


Example 5.7 


(Pendulum) Determining the motion of a pendulum is a classical problem 
in mechanics. This example shows different ways to proceed. Consider a fric- 
tionless pendulum of length | whose bob has mass m (Figure 5.9). As a state 
variable we choose the angle 0 = 0@(t) that the pendulum makes with the ver- 
tical. As time passes, the bob goes back and forth and traces out an arc on a 
circle of radius |. Let s denote the arclength measured from rest (@ = 0) along 
the arc. By simple geometry s = /@. As the bob moves, its kinetic energy is 
one-half its mass times the velocity squared, or 


1 ae | Baird 


Its potential energy is mgh, where h is the height above the zero-potential 
energy level, taken where the pendulum is at rest. Therefore the potential 
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mg 


Figure 5.9 A pendulum consisting of a mass m attached to a rigid weightless 
rod of length J. The force of gravity is mg, directed downward. The potential 
energy is mgh where h is the height of the mass above the equilibrium position. 
The kinetic energy is computed along the path of motion, the arc. The arc 
length is s = 10 and the velocity is s’ = 16’. So the kinetic energy is (m/2)I?(6’)?. 


energy is 
PE = mgl(1—cos6). 


Energy is conserved, so 
1 
silo)? + mgl(1— cos6) = E, (5.17) 


where F is the constant energy. If we displace the bob and release it, the initial 
conditions are 0(0) = 0) and 6’(0) = 0. Using (5.17) we can calculate the total 
energy in this configuration. Using the variable w(t) to denote the angular 
velocity, 


w(t) = O'(t), 


we can write the conservation law as 


w= 4/5 VE gill — 080). (5.18) 


We can plot orbits in the 6w phase plane by the graphical method illustrated in 
the last example. We plot energy E and potential energy on the same coordinate 
axes, energy vs. 6, and graphically subtract to get the orbits in the Ow phase 
plane. 

We can use (5.18) to find @(t) implicitly by separating variables and inte- 
grating; we obtain 


“| dé 
2 a ee 5 
2 \/E — mgl(1 — cos 6) 
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Figure 5.10 Phase-plane diagram for the pendulum. The critical points are 
(n7z,0), which are saddles for n odd, and centers for n even. The oscillations 
are clockwise because 6’ = w > 0 for w > 0. 


The integral on the right cannot be found in terms of standard functions, but 
rather in terms of special functions called elliptic functions. These are cataloged 
in tables and software. We leave it to the reader to explore this topic. If we 
differentiate the conservation law (5.17) with respect to t and use the chain 
rule, we get 

6 + sind 2H; (5.19) 


which is a second-order nonlinear DE in @(t) called the pendulum equation. 
Equation (5.19) is Newton’s second law of motion. It can also be derived directly 
by determining the forces on the bob, which we leave as an exercise. We can 
clearly write (5.19) as a system 


0 =a, 


w= —5 sind. 


The critical points are (0.,we) = (n7,0), n = 0, +1, +2,.... The Jacobian 
matrix at these points is therefore 


0 1 0 1 
Ho 0)=( g onn 0) =( gaye 0): 


This implies that the eigenvalues of J are \ = t+ /g/l for n odd, and therefore 
the critical points (n7,0) are saddle points; if n is even, then the eigenvalues 
are purely imaginary, \ = ti,/g/l, and the linearized system has a center 
at (nz,0). This latter case is the exceptional case and we cannot conclude 
automatically that the even critical points are centers for the nonlinear system. 
As it turns out, they are in fact centers, as the geometrical argument above 
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shows. The phase plane diagram (Figure 5.10) shows the critical points for n = 
—2,—1, 0, 1,2 with the saddle and center structures. For states 6 between —7 
and 7, only the middle portion of the phase plot with a center is applicable; the 
states 0 = 7 or 0 = —7 represent cases where the pendulum is inverted, which 
are clearly unstable states (the saddles). The curves connecting the saddle 
points are separatrices. For large energies, the pendulum will continually spin 
around, represented by the top and bottom orbits in the diagram. 


EXERCISES 


1. Formulate the second-order nonlinear equation 


ce! +a72'-2« =0 


as a system of two first-order equations. Find the critical points and classify 
them as to type and stability. 


2. Consider a dynamical system governed by the equation «” = —2+ 2°, with 
mass m = 1. 


a) Find the potential energy V(a) with V(0) = 0. 
b) What is the total energy F is in the system if x(0) = 2 and 2/(0) = 1? 
c) Using the conservation law, plot the orbit in the xy phase plane of 


a particle having this amount of total energy. Indicate by arrows the 
direction that this orbit is traced out as time increases. 


3. Consider a dynamical system governed by the equation 2” = —2?. 


a) Find the potential energy V(x) with V(0) = 0 and write the conserva- 
tion of energy law. 


b) Determine the total energy EF of the system if 7(0) = 1 and 2’(0) = 0. 


c) Plot the orbit in the xy phase plane of a particle having this amount 
of total energy and indicate by arrows the direction that the orbit is 
traced out as time increases. 


d) Explain in words how the system changes as time increases. 


4. In the preceding exercise, find an implicit formula for the solution x = x(t) 
of the DE and initial conditions. 


5. In a nonlinear spring—mass system the equation governing the position is 
" 3 
a = —2e°. 


a) Show that conservation of energy for the system can be expressed as 


y? = C — «*, where C is a constant. 


270 5. Nonlinear Systems 


b) Plot this set of orbits in the phase plane for different values of C. 


c) If #(0) = 2 > 0 and 2’(0) = 0, show that the period of the oscillations 
is 


puk i) anaes 
Xo Jo JVi—rt 
Sketch a graph of the period T versus the initial position xo. 
6. Consider a conservative system with mass m = 2 whose potential energy 
is 
V(a) = (x +1)? (a — 2)?. 


a) What is the force? 


b) Using graphical techniques described in this section, draw the curves 
(orbits) in zy phase space of constant energy for the case FE = 1, 2, 3. 


c) As time increases, indicate the direction of motion on the orbits. 


d) Ifthe mass starts at « = 0, y = 3 at t = 0, describe how its position « = 
x(t) changes over time. Estimate its maximum positive and negative 
displacement from x = 0. 


7. Newton’s law of gravity states that the equation of motion for a mass m 
in the gravitational field of the earth of mass M is 


vn  GMm 
ee RP 
where R is the radius of the earth, x is the height of the object above 
the surface of the earth, and G is the universal gravitational constant. 
The force on the right side is the inverse-square law. At the surface the 
force is —mg, where g is the gravitational acceleration at sea level. Thus, 
GMm/R? = mg and we can write 


Wo gR? 
(x + R)?’ 


Initially, assume that x(0) = 0 and 2’(0) = yo, where yo is the initial 
velocity. 


a) Find the potential energy function V(x) assuming V(0) = 0, and write 
the conservation of energy law. 


b) Show that the velocity is given by 


R 
yr=u v8 -2oR (1-25). 
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c) Using the graphical techniques described in this section, sketch three 
orbits in phase space for the cases yo > /2gR, yo = V2gR, and yo < 
V2gh. Explain these orbits and state why is /2gR called the escape 
velocity? 


d) Show that /2gR is approximately 11.1 km/sec. Give the answer in 
miles per hour. 


8. Derive the pendulum equation (5.19) from the conservation of energy law 
(5.17). Hint: Take the derivative with respect to ¢, using the chain rule. 


9. Derive the pendulum equation (5.19) from Newton’s second law of motion 
by finding the force on the bob in an arbitrary position on its arc of motion. 
Hint: Use arclength s = s(t) measured from rest (@ = 0) as the position 
coordinate and observe that the downward force mg can be resolved into 
a force tangential to the path and a force normal (perpendicular) to the 
path. 


10. A pendulum of length 0.5 meters has a bob of mass 0.1 kg. If the pendulum 
is released from rest at an angle of 15 degrees, find the total energy in the 
system. 


11. When the amplitude of oscillations of a pendulum is small, then sin@ is 
nearly equal to 6 (why?), and the nonlinear equation is approximated by 
the linear equation 6” + (g/1)0 = 0. 


a) Show that the approximate linear equation has a solution of the form 
6(t) = Acoswt for some value of w satisfying the initial conditions 
6(0) = A, 6’(0) = 0. What is the period of the oscillation? 


b) A 650 lb wrecking ball is suspended on a 20 m cord from the top of 
a crane. The ball, hanging vertically at rest against the building, is 
pulled back a small distance and then released. How soon does it strike 
the building? 


12. Consider the nonlinear dynamical system 


gay, y =-l-y+z2’. 
(a) Find the critical points, nullclines, and direction field in the differ- 
ent regions in the plane. (b) Given that one of the critical points is an 
asymptotically stable spiral, determine the type and stability of the other 
equilibria. (c) Draw several key orbits. 


13. Consider the nonlinear dissipative system 


a=y, yo =-a-y’. 
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Show that the function V(a,y) = x? + y? decreases along any orbit 
(i.e., (d/dt)V (a(t), y(t)) < 0), and state why this proves that every orbit 
approaches the origin as t > ++oo. 


14. The dynamics of a dissipative mechanical system is given by the differential 
equation (Newton’s law) 


ma” = —ka'—V'(x), k>0, 


where V(x) is the potential energy in the case k = 0. (Recall, V’ denotes 
the x-derivative.) Show that the damping term has the effect of dissipating 
the energy, E = $m(a’)? + V(x), in the system; precisely, show that 


dE iS 


15. (Frictional pendulum) Suppose that a simple pendulum is also subject to 
a frictional force in its joint of magnitude k6’, where k is the damping 
constant. (a) What is the equation of motion? (b) If E = $w? + (g/I)(1— 
cos@), show that E’ = —kw? < 0. Interpret this result. (c) If 0(0) = 7/12 
and 6’(0) = 0, sketch approximately the orbit in the Ow phase plane. 


5.3 Applications 


In the last section we saw examples of nonlinear systems in physics. Nonlinear 
equations also play a central role in population ecology, epidemiology, virology, 
biochemistry, physiology, and many other areas in the life sciences, as well as 
in economics and social sciences. In the next few sections we examine some 
of these models. They are easily understood, without significant background, 
using the mathematical tools we now have available. 


5.3.1 The Lotka—Volterra Model 


We formulate and study a simple model of predator—prey dynamics. Let « = 
x(t) be the prey population and y = y(t) be the predator population. We 
can think of rabbits and foxes, food fish for sharks, or any consumer—resource 
interaction, including herbivores and plants. 

If there are no predators we assume the prey dynamics is 2’ = ra, or 
exponential growth, where r is the positive per capita growth rate. In the 
absence of prey, we assume that the predator dies via y’ = —my, where m is 
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the per capita mortality rate. When there are interactions, we must include 
terms in the dynamics that decrease the prey population and increase the 
predator population. To determine the form of the predation term, we assume 
that the rate of predation, or the number of prey consumed per unit of time, per 
predator, is proportional to the number of prey. That is, the rate of predation, 
per predator, is az, where a > 0 is a constant. In ecology, this is called the 
predator’s functional response. Thus, if there are y predators, then the rate 
that prey is consumed is axy. This interaction term is proportional to ry, the 
product of the number of predators and the number of prey. For example, if 
there were 20 prey and 10 predators, there would be 200 possible interactions; 
only a fraction of those, a, is assumed to result in a kill. The parameter a, 
called the capture efficiency, depends upon the fraction of encounters and the 
success of the encounters. 

The prey consumed increases the population of predators by the rate caxy, 
where € is the conversion efficiency, or yield, of the predator population. (Or, 
the number of predators produced by consumption of a single prey; one prey 
consumed does not mean one predator born.® Therefore, we obtain the simplest 
model of predator—prey interaction, called the Lotka—Volterra model: 


gv =rxz—azy, 
y' = —my + bay, 
where b= €a. 

This model was developed by A. Lotka and V. Volterra in the mid-1920s, 
and is really the first, and simplest model in ecology showing how populations 
can cycle. It was one of the first mechanistic models to explain qualitative 
observations in natural systems. 


Remark 5.8 


It is important to point out that the term axy, representing the predation rate, 
is a common interaction term in science. In chemistry, if two molecules A and 
B react to form a product C, or symbolically, A + B —- C, then the law of 
mass action states that the rate of the chemical reaction is proportional to the 
product of the concentrations of A and B, or 


reaction rate = k|A][B]. 


The constant & is the rate constant. For diseases, the rate of infection transmis- 
sion is often taken to be aSJ, where S is the number of susceptible individuals 


° One can argue that instead of numbers, we should be working with biomass of prey 
and predators. 
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and I is the number of infected individuals; the constant a is the transmission 
rate, or the fraction of encounters that lead to infection of a susceptible. 


To analyze the Lotka—Volterra model we factor the right sides of the equa- 
tions to obtain 
zc =a2(r—ay), y’ =y(—-m+bz). (5.20) 


Here, we have x, y > 0, so we work in the first quadrant. It is simple to locate 
the critical points, or equilibrium populations. Setting the right sides equal to 
zero gives two solutions, x = 0, y = 0 and « = m/b, y = r/a. Thus, in the 
phase plane, the points (0,0) and (m/b,r/a) represent equilibria. The origin 
represents extinction of both species, and the nonzero equilibrium represents a 
possible coexistent state. 

To determine the type and stability of the equilibria and orbits we plot the 
nullclines, the curves in the xy plane where the vector field is vertical (a’ = 0) 
and curves where the vector field is horizontal (y’ = 0). The z-nullclines for 
(5.20), where x’ = 0, are x = 0 and y = r/a. The y-nullclines, where y’ = 0, 
are y = 0 and x = m/b. The orbits cross these lines horizontally. Notice that 
the equilibrium solutions are the intersections of the x- and y-nullclines. 

The nullclines partition the plane into four regions where 2’ and y’ have 
various signs, and therefore we can obtain a direction field indicating directions 
of the orbits. See Figure 5.11. 


YR y-nullcline 


rlap------ | = 
I 
} x’>0 hy le 7 x’>0 


y’>0 


—_> > 
xX 


I 
(0, 0) m/b 


Figure 5.11 Nullclines (dashed) and vector field in regions between the null- 
clines. The x and y axes are both nullclines and orbits. 


Along each nullcline we find the direction of the vector field. For example, 
on the ray to the right of the equilibrium we have x > m/b, y = r/a. We 
know the vector field is vertical so we need only check the sign of y’. We have 
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y’ = y(—m + bax) = (r/a)(—m + bx) > 0, so the vector field points upward. 
Similarly we determine the directions along the other three rays. These are 
shown in the accompanying Figure 5.11. Note that lines y = 0 and 7 = 0 are 
both nullclines and orbits. For example, along « = 0 we have y’ = —my, or 
y(t) = Ce~™; when there are no prey, the predators die out. Similarly, when 
y = 0 we have x(t) = Ce”, so the prey increase in number. 

Finally, we can determine the direction of the vector field in the regions 
between the nullclines either by selecting an arbitrary point in that region and 
calculating x’ and y’, or by just noting the sign of 2’ and y’ in that region. 
For example, in the northeast quadrant, above and to the right of the nonzero 
equilibrium, it is easy to see that 2’ < 0 and y’ > 0; so the vector field points 
upward and to the left, or in a NW direction. We can complete this task for 
each region and obtain directions shown in Figure 5.11. 

Near (0,0) the orbits are SE and appear to veer away from the equilib- 
rium. This seems to indicate a saddle structure; clearly, the x and y axes are 
separatrices. It appears that orbits circle around the nonzero equilibrium in a 
counterclockwise fashion. But at this time it is not clear if they form closed 
paths (a center) or spirals (stable or unstable). More analysis is needed and we 
look at the linearization. 

The Jacobian matrix is 


root ( HE Me) -("G" ate) 


10,0)=(§ _y ): 


which has eigenvalues r and —m. Thus (0,0) is a saddle, confirming our previous 


We have 


observation. For the nonzero equilibrium, 


Homb.r 10) = (srg — 


The characteristic equation is \? + rm = 0, and therefore the eigenvalues are 
purely imaginary: 4 = +,/rmi. This is the exceptional case and we cannot 


conclude that the equilibrium is a center. Again, further analysis is required. 
We can obtain the equation of the orbits by the now standard technique of 
dividing the two equations. We get 


vf dy y(—m-+ be) 
a’ dx  2a(r—ay) - 


Rearranging and integrating gives 


= br — 
i shay = [= dx +C, 
y av 
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or 
rlny—ay=be—-mlnxz+C, 


which is the algebraic equation for the orbits. It is obscure how to plot these 
curves because it is not possible to solve for either of the variables. A different 
argument is required. If we exponentiate we get 

yew _ ef cbt ym 
Now consider the y nullcline where x is fixed at a value m/b, and fix a positive 
C value (i.e., fix an orbit). The right side of the last equation is a positive 
number A, and so we can write it as 


y’ = Ae”, 


The left side is a power function and the right side is an exponential function. 
If we plot y” and Ae®”, we observe that there can be at most two intersections; 
therefore, this equation can have at most two solutions for y. In summary, along 
the vertical line « = m/b, there can be at most two crossings, and therefore the 
orbit cannot spiral into or out from the equilibrium point. We conclude that the 
equilibrium is a center with closed periodic orbits encircling it counterclockwise. 

The phase diagram is shown in Figure 5.12. Time series plots of the prey and 
predator populations are shown in Figure 5.13. When the prey population is 
high the predators have a high food source and their numbers start to increase, 


Figure 5.12 Closed, counterclockwise, periodic orbits of the Lotka—Volterra 
predator—prey model. 
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thereby eventually driving down the prey population. Then the prey population 
gets low, ultimately reducing the number of predators because of lack of food. 
Then the process repeats, giving cycles. 


populations 


time t 


Figure 5.13 Time series solution to the Lotka—Volterra system showing the 
predator (dashed) and prey (solid) populations. 


In summary, the nonzero equilibrium is stable. A small perturbation from 
equilibrium puts the populations on a periodic orbit that stays near the equi- 
librium; the system does not return to that equilibrium and the equilibrium 
is not asymptotically stable. The other equilibrium, the origin, corresponds to 
extinction of both species and is an unstable saddle point. 


5.3.2 Population Ecology 


In the Lotka—Volterra model the rate of predation (prey per time, per preda- 
tor) is assumed to be proportional to the number of prey (i.e., az). Thinking 
carefully about this assumption leads to concerns. Increasing the prey density 
indefinitely leads to an extremely high per predator consumption rate, which 
is clearly impossible for any consumer. It seems more plausible that the rate 
of predation has a limiting value as the prey density gets large. In the late 
1950s, C. Holling developed a functional form that has this limiting property 
by partitioning the time budget of the predator. He reasoned that the num- 
ber N of prey captured by a single predator is proportional to the number x 


278 5. Nonlinear Systems 


of prey and the time T, allotted for searching.!° Thus N = aT,x, where the 
proportionality constant a is the effective encounter rate. But the total time 
T available to the predator must be partitioned into search time T, and total 
handling time T;,, or T = T, + Ty. The total handling time is proportional to 
the number captured, 7;, = hN, where h is the time for a predator to handle a 
single prey. Hence N = a(T — hN)z. Solving for N/T, which is the predation 
rate, gives 

N ax 

T 1+ahx ype) 
This function for the predation rate is called a Holling type II response, or 
the Holling disk equation. Note that lim,_,.. az/(1 + ahx) = 1/h, so the rate 
of predation approaches a constant value. The quantity N/T is measured in 
prey per time, per predator, so multiplying by the number of predators y gives 
the predation rate for y predators. 

If the encounter rate a is a function of the prey density (e.g., a linear function 

a = bax), the the predation rate is 


N bx? 

T 1+ bha?’ 
which is called a Holling type III response. Figure 5.14 compares different 
types of predation rates used by ecologists. For a type III response the predation 
is turned on once the prey density is high enough; this models, for example, 


(Type III) 


predators that must form a “prey image” before they become aware of the prey, 
or predators that eat different types of prey. At low densities prey go nearly 
unnoticed; but once the density reaches an upper threshold the predation rises 
quickly to its maximum rate. 

Replacing the linear per predator feeding rate ax in the Lotka—Volterra 
model by the Holling type IT response, we obtain the model 


oe See y 
1+ahx”’ 
‘ ie 
=—m 
. y l+ah x 


We can go another step and replace the linear growth rate of the prey in 
the model by a more realistic logistic growth term. Then we obtain the 
Rosenzweig—MacArthur model 


w! =ra(1-4)-—“_y 
K 1+aha”’ 
peat 
=— €——-y. 
y 1+ aha” 


1 We are thinking of x and y as population numbers, but we can also regard them 
as population densities, or animals per area. There is always an underlying fixed 
area where the dynamics is occurring. 
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Lotka-Volterra 


type Il 


predation rate 


Figure 5.14 Three types of feeding rates, or predation rates, studied in ecol- 
ogy. The predation rate is measured in prey per time, per predator. 


Otherwise, a type ITI response could be used. All of these models have very 
interesting dynamics. Questions abound. Do they lead to cycles? Are there 
persistent states where the predator and prey coexist? Does the predator or 
prey population ever go to extinction? What happens when a parameter, for 
example, the carrying capacity K, increases? Some aspects of these models are 
examined in the exercises where the techniques of this chapter come into full 
play. 

Many other types of population models have been developed for interacting 
species. Competition models, where two species compete for an ecological niche, 
are among many. A simple competition model takes the form 


xv =af(x) —azy, 

y' = yg(y) — bry, 

where f(a) and g(a) are per capita growth rates for each species. The interac- 
tion terms —axy and —bxy are both negative and lead to a decrease in each 
population. When both interaction terms are positive, then the model is called 
a cooperative model. 

Finally, we state a qualification and warning about these types models in 
biology. In the natural world predator-prey interactions, for example, are very 
complex and subtle. Interactions are never between only two species, and there 
are other abiotic effects, such as temperature, that are completely ignored. 
Therefore, we should not expect too much from population models. They are 
not based on physical laws like the laws in physics. Simply put, they are mod- 
els, or caricatures of natural phenomena. However, models do provide some 
truths that are useful in understanding these interactions, and their study and 
development are firmly established in the biology literature. 
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Dimensionless Equations* 


Models are complicated by the presence of several parameters. This makes 
analysis of models extremely tedious. Additionally, it is hard to understand 
the effect of a parameter on the behavior of solutions, even when we perform 
numerical calculations. Fortunately there is strategy that eliminates some of 
these complications. Formulating models in terms of dimensionless vari- 
ables often decreases the number of parameters in a problem, leading to a 
significant economical improvement. This well known practice is standard fare 
in engineering and biology and belongs to the subject of dimensional analysis. 

The idea is to define new, dimensionless independent and dependent vari- 
ables using special combinations of the dimensioned parameters in the prob- 
lem. The result is a problem that is completely free of dimensions, including 
the parameters. 


Example 5.9 


The modified Lotka—Volterra model with logistic growth of the prey is 


av =rx (1 = =) — ary, 

y =—my + bry, 

which contains 5 parameters. We show that this model can be reduced down to 
one with only 2 parameters. First, we find the dimensions of all the parameters 
and variables in the problem. Clearly, the variables t, x, and y have dimensions 
time, prey, and predators. We use the square brackets notation |--] to denote 
dimensions; thus 


[t] =time, [x] = prey, [y] = predators. 


By comparing terms in the equations, noting that all terms must agree in 
dimension (apples can’t be added to oranges), we can find the dimensions of 
the parameters. 


1 1 1 


[r] = [m] = [K] = prey, [a] 


time’ 


~ time - predator’ ~ time - prey. 


We next divide each variable by a combination of parameters that have the 
same dimension as the variable; then that ratio, which is a new variable, will 
be dimensionless, meaning dimensions cancel out. There may be several ways 
to do this. Here, we define new dimensionless variables by 

x 


Be, See i 
OT geen OO ae — orfa 
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The denominators in the expressions above are often called scales. We say, for 
example, the carrying capacity K is a scale for the prey population. Notice, for 
example, the dimensionless prey population it just the prey population relative 
to the carrying capacity. 

Finally, we change variables in the equations. Noting that derivatives change 
according to 


pode KX) dX) _ dy _ al(rfa)a¥) _ 12 ax 
dt = d(r~'dr) dr’ dt d(r—'dr) a dr- 
Substituting all the new variables into the original equations gives 
dX r 
Kr =rKX(1-—X)- a( KX), 
2 
eee eyo e8c 
a dr a a 
Simplifying gives 
X 
ues = X(1-— X)- XY, 
dt 
dX = ye + OK yy 
dt r r 


Therefore, we can define new parameters by 


which are dimensionless. Thus, the final dimensionless form of the model is 


dX 

TAU X)- AY, 
OF in AR 

dt 


which has only 2 parameters! This problem much easier to analyze. 


The process of non-dimensionalization is extensive and can be very subtle 
in myriad ways. This important topic of dimensional analysis is discussed, for 
example in detail, in the classic text by Lin and Segel (1974), or in Logan (2013). 
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EXERCISES 


1. If, in the Lotka—Volterra model, we include a constant harvesting rate h of 
the prey, the model equations become 


xv =rx—ary—h 


/ — 


y =—my + bay. 


Explain how the equilibrium is shifted from that in the Lotka—Volterra 
model. How does the equilibrium shift if both prey and predator are har- 
vested at the same rate? Compare the observed differences. 


2. Non-dimensionalize the Lotka—Volterra model with harvesting in the pre- 
vious exercise to obtain the system 


dX dY 
—=X-XY-yn, —=-pX4+XY, 
dt dt 
and show that the two parameters y and 7 are dimensionless. Hint: Take 
t x y 
= — VY = —— 
7 rol? r/o? r/a 


3. Modify the Lotka—Volterra model to include refuge. That is, assume that 
the environment always provides a constant number of hiding places where 
the prey can avoid predators. Argue that 


ve =rx—a(a—k)y 

y =—my + b(a — k)y. 
How does refuge affect the equilibrium populations compared to no refuge? 

4. Consider a predator-prey model based on the Lotka—Volterra model, but 
with predator migration out of the region at a constant rate M: 
x-=ar— bay, y’ =—-cyt+dry—M, c<d. 

Find the equilibrium and sketch the nullclines. Determine the nature and 
stability of the equilibrium, and state how the system evolves in time. 


5. A simple cooperative model where two species depend upon mutual coop- 
eration for their survival is 


wv! = —kx + axy 


a 


y =—my + bey. 


Find the equilibria and identify, insofar as possible, the region in the phase 
plane where, if the initial populations lie in that region, then both species 
become extinct. Can the populations ever coexist in a nonzero equilibrium? 
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6. In the first quadrant thoroughly analyze the competing species equations: 


d. 
F = 142 — 22? — zy, 


dy 


= l6y — 2y? — xy. 
Ai 6y — 2y~ — xy 


7. In the first quadrant thoroughly analyze the competing species equations: 
dx 


1 dy 1 
— = 14x — =2? — — = l6y— =y’ — ay. 
dt ro Se OD ae Dg 


8. Two populations X and Y grow logistically and both compete for the same 
resource. A competition model is given by 


dX xX dY Y 
A anx (1-2) -nxy, @ any (1-2) -mxy. 


The competition terms are 6;XY and bo XY. 


a) Nondimensionalize this model by choosing dimensionless variables 


t T XxX Y 
=—7; Lo SS 5 — 
cer Kr * 


thus deriving the dimensionless model 
ve =a(1—2x)—aay, y! =cy(1—y) — bay, 


where a, b, and c are appropriately defined dimensionless parameters. 
Give a biological interpretation of these parameters. 


b) In the case a > 1 and c > b determine the equilibria, the nullclines, 
and the direction of the vector field on and in between the nullclines. 


c) Determine the stability of the equilibria by sketching a generic phase 
diagram. How will an initial state evolve in time? 


d) Analyze the population dynamics in the case a > 1 and c < b. 


9. For x, y > 0, consider the system 


, axy } axy 
e= = 2; =-— —yt, 
l+y d 7 


where a and b are positive parameters with a > 1 and b > 1/(a—1). 


a) Find the equilibrium solutions, plot the nullclines, and find the direc- 
tions of the vector field along the nullclines. 


b) Find the direction field in the first quadrant in the regions bounded by 
the nullclines. Can you determine from this information the stability 
of any equilibria? 
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11. 


12. 
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Consider the model 


; a 5a? 
4+ 42° 
In the first quadrant only, find all equilibrium solutions, sketch nullclines, 


and indicate the direction of the vector field in all the regions of the first 
quadrant. 


Savannas are ecosystems characterized by co-dominance of trees and 
grasses. A simple model for the competition between these two species 
is given by 

dT dG 


ae = aT(1 iF T) = d,T, ae = c2G(1 Fy G) a one = dzG, 


where T and G are the fractions of trees and grasses, respectively, in the 
savanna; thus, T+ C' = 1. We assume the constants, all positive, satisfy 


d co — d 
dy < cq, 1l- a < aoe, 
C1 Cy + C2 
a) Write a short paragraph explaining the terms in the model. 
b) Determine the type and stability of the critical points, and draw the 
nullclines and key orbits in the phase plane. Is there a coexistent state? 

c) Assume the relation among the constants is changed to 

d co — d. 

ing, LS SS, 
on Cy + C2 


Explain what happens in this case. Hint: Analyze the phase plane. See 
F. Accatino et al., J. Theor. Biol. (2010), pp 235-242, for a discussion 
of the effects of rainfall and fire. 


The dynamics of two competing species is governed by the system 


xv =2(10-—2—-Yy), 
y' = y(30 — 2x — y). 
Find the equilibria and sketch the nullclines. Use the Jacobian matrix to 


determine the type and stability of each equilibrium point and sketch the 
phase diagram. 
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13. The dynamics of two competing species is given by 


a’ = 4a(1—2/4)— xy, 
y’ = 2y(1 — ay/2) — bry. 


For which values of a and b can the two species coexist? Physically, what 
do the parameters a and b represent? 


14. A predator—prey model is given by 


a’ =re (1-2) - flay, 

y = —my + ef (x)y, 
where r, m, c, and K are positive parameters, and the predation rate f(x) 
satisfies f(0) = 0, f’(x) > 0, and f(a) — M as 4 > cw. 


a) Show that (0,0) and (K,0) are equilibria. 


b) Classify the (0,0) equilibrium. Find conditions that guarantee (K, 0) 
is unstable and state what type of unstable point it is. 


c) Under what conditions will there be a nonzero equilibrium in the first 
quadrant? 


5.3.3 Epidemics; Chemical kinetics 


Measles, flu, chicken pox, whooping cough, ebola, HIV-AIDS, malaria, MRSA, 
hepatitis—is a very short list of the many, many infections that can affect the 
human species. Some epidemics, like bubonic plague, killed perhaps a third of 
the inhabitants in Europe in the middle ages. The Spanish flu killed as many 
as 40-50 million in the early 1900s. It is not surprising that great efforts have 
made to understand the dynamics of diseases, both from a population scale and 
now from a microscopic scale. In this section we introduce some simple models 
of the spread of an infectious disease. 

We consider a simple epidemic model where, in a fixed population of size 
N, the function J = I(t) represents the number of individuals that are infected 
with a contagious illness and S = S(t) represents the number of individuals that 
are susceptible to the illness, but not yet infected. We also introduce a removed 
class where R = R(t) is the number who cannot get the illness because they 
have recovered permanently, are naturally immune, or have died. We assume 


N = S(t) + I(t) + R(d), 
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and each individual belongs to only one of the three classes. Observe that N 
includes the number who may have died. The evolution of the illness in the 
population can be described as follows. Infectives communicate the disease to 
susceptibles with a known infection rate; the susceptibles become infectives who 
have the disease a short time, recover (or die), and enter the removed class. 
Our goal is to set up a model that describes how the disease progresses with 
time. These models are called SIR models. 

In this model we make several assumptions. First, we work in a time frame 
where we can ignore births and immigration. Next, we assume that the popula- 
tion mixes homogeneously, where all members of the population interact with 
one another to the same degree and each has the same risk of exposure to the 
disease. Think of measles, the flu, or chicken pox at an elementary school or 
small college campus. We assume that individuals get over the disease quickly, 
so we are not modeling tuberculosis, AIDS, or other long-lasting or permanent 
diseases. Of course, more complicated models can be developed to account for 
all sorts of these factors, and other factors such as vaccination, the possibility 
of reinfection, and so on. 

The disease spreads when a susceptible comes in contact with an infec- 
tive. A reasonable measure of the number of contacts between susceptibles and 
infectives is S(t)I(t). For example, if there are five infectives and twenty sus- 
ceptibles, then one hundred contacts are possible. However, not every contact 
results in an infection. We use the letter a to denote the effective trans- 
mission coefficient, or the fraction of those contacts that usually result in 
infection. For example, a could be 0.02, or 2 percent. The parameter a is the 
product of two effects, the fraction of the total possible number of encounters 
that occur, and the fraction of those that results in infection. The constant a 
has dimensions time! per individual. The quantity aS$(t)I(t) is the infection 
rate, or the rate that members of the susceptible class become infected. Observe 
that this model is the same as the law of mass action in chemistry where the 
rate of chemical reaction between two reactants is proportional to the product 
of their concentrations; it is also the same as the Lotka—Volterra interaction 
model. Therefore, if no other processes are included, we would have 


S’=-aSI, I' =aSI. 


But, as individuals get over the disease, they become part of the removed class 
R. The recovery rate r is the fraction of the infected class that ceases to be 
infected; thus, the rate of removal is rI(t). The parameter r is measured in 
time! and 1/r can be interpreted as the average time to recover. Therefore, 
we modify the last set of equations to get 


S' =—aSI, (5.21) 
I’ =aSI-—rl. (5.22) 
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These are our working equations. We do not need an equation for R’ because 
R can be determined directly from R = N —S— I. At time t = 0 we assume 
there are Jp infectives and Sp susceptibles, but no one yet removed. Thus, initial 
conditions are given by 


S00) =, 10V= Ip, (5.23) 


and So + Jo = N. SIR models are commonly diagrammed as in Figure 5.15 
with S, I, and R compartments and with arrows that indicate the rates that 
individuals progress from one compartment to the other. An arrow entering a 
compartment represents a positive rate and an arrow leaving a compartment 
represents a negative rate. 


as! rl 
S —> I —>!| R 


Figure 5.15 In an SIR model: compartments representing the number of 
susceptibles, the number of infectives, and the number removed, and the flow 
rates in and out of the compartments. 


Qualitative analysis can help us understand how an orbit, or solution curve 
S = S(t), I = I(t), behaves in the first quadrant of the SI phase plane. Refer 
to Figure 5.16. First, the initial value must lie on the straight line J = —S+N. 
Where then does the orbit go? Note that S’ is always negative so the orbit must 
always move to the left, decreasing S'. Also, because I’ = I(aS'—r), we see that 
the number of infectives increases if S > r/a, and the number of infectives 
decreases if S < r/a. This information gives us the direction field; left of the 
I nullcline, or vertical line S = r/a, the curves move down and to the left and 
to the right the curves move up and to the left. Observe that we are assuming 
r/a< N. (The other case is requested in the exercises.) 

If the initial condition is at point P in Figure 5.16, the orbit goes directly 
down and to the left until it intersects J = 0, and the disease dies out. If the 
initial condition is at point Q, then the orbit increases to the left, reaching a 
maximum at S = r/a. Then it decreases to the left and ends on I = 0. 

There are two questions remaining, namely, how steep the orbit is at the 
initial point, and where on the S axis does the orbit terminate. Figure 5.16 
anticipates the answer to the first question. The total number of infectives and 
susceptibles cannot go above the line of possible initial conditions, [+ S = N, 
and therefore the slope of the orbit at t = 0 less than —1, the slope of the line 
I+S = N. To analytically resolve the second issue we can obtain a relationship 
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Figure 5.16 The SJ phase plane showing two orbits in the case r/a < N. One 
starts at P and and one starts at Q, on the line J+ S = N. The second shows 
an epidemic where the number of infectives increases to a maximum value and 
then decreases to zero; S* represents the number that does not get the disease. 


between S and J along a solution curve as we have done in previous examples. 


Dividing the equations (5.21)—(5.22) we obtain 


I’ difdt | Ge = r 
S' dS/dt dS  -aSI as’ 
Thus 
ee 
dS aS” 


Integrating both sides with respect to S' (or separating variables) yields 
P=-8+_lS 4c, 
a 


where C is an arbitrary constant. From the initial conditions, C = N — 
(r/a) In So. So the solution curve, or orbit, is 


T=-S+imS+N-——mS=-S+N+—2mn—. 

a a a So 
This curve can be graphed with a calculator or computer algebra system, once 
parameter values are specified. Figure 5.16 shows the orbits. Notice that the 
orbits cannot intersect the J axis where S = 0, so it must intersect the S axis 
at I = 0, or at the root S* of the nonlinear equation 


Sieh Ne col. 
a So 
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See Figure 5.16. This root represents the number of individuals who do not get 
the disease. Once parameter values are specified, a numerical approximation 
of S* can be obtained. In all cases, the disease dies out because of lack of 
infectives. Therefore, a qualitative analysis of the phase plane gives a good 
resolution of the disease dynamics. 

Generally, we are interested in the question of whether there will be an 
epidemic when there are initially a small number of infectives. The number 

eg = 250) 


r 
is a threshold quantity called the basic reproductive number, and it deter- 
mines if there will be an epidemic. For example, suppose there be a single 
infective at t = 0. That person infects susceptibles at the rate alS = a-1-$(0). 
Also, that infective has the illness an average time of 1/r. Therefore a sin- 
gle infective would infect, on the average, Ro = a$(0)/r individuals. If Ro > 1 
there will be an epidemic (the number of infectives increase), and if Ry < 1 then 
the infection dies out. We think of Ro as the number of secondary infections 
produced by a single infective. 

In this problem we did not do a critical point analysis. Note that all the 
critical points are nonisolated, lying along the S axis. This makes our previous 
results about isolated critical points unusable. 

Next we consider a simple model of how an enzyme works to break down 
a substrate molecule. Enzymes are catalysts that are present in low concentra- 
tions but have a rapid effect on a reaction which would otherwise take too much 
time to be effective in cellular processes. This is a classical problem in biochem- 
istry, and it is the first step in studying other chemically reacting systems, such 
as activation and inhibition, metabolic pathways, cooperative phenomena, and 
even virology. The key idea in formulating dynamical equations for the concen- 
trations of chemical constituents is the Law of Mass Action, which states 
that a reaction of the form 


mX +nY 4 products, 


where m molecules of X and n molecules of Y react to form products, has rate 
r=ka™y”. That is, it is proportional to the products of the reactant concen- 
trations x and y raised to the powers of the number of the molecules involved 
in the reaction. The proportionality constant k is called the rate constant. 


Example 5.10 


(Enzyme kinetics) Among the significant applications of nonlinear systems 
are the models of chemical kinetics. These describe how concentrations of chem- 
ical species evolve in reactions. In this example we give a simple compartmental 
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model of Michaelis-Menten enzyme kinetics, where a substrate S is reduced by 
an enzyme FE. (An example is the hydrolysis of sucrose by invertase.) The basic 
enzyme reaction is 


Sera PLE, (5.24) 


where molecules S (substrate) and £ (enzyme) combine to form a complex 
molecule C. The complex C' breaks up to form a product molecule P and 
the original enzyme E, or the reverse reaction, where C’ disassociates into the 
original reactants S and E. There are three reactions in (5.24), namely 


Serpac cSein chrag 


The initial formation of the complex C is a rapid reaction, and usually the 
initial concentration of the enzyme is small compared to the substrate. The 
only assumption required to reduce the chemical equation to a dynamical model 
is the Law of Mass Action. As remarked above, it states that the rate of a 
chemical reaction is proportional to the product of the concentrations entering 
the reaction. The k’s in the chemical reactions above are the proportionality 
constants and they are called the rate constants. If we denote the concentrations 
of S, E, C, and P by lower case letters s, e, c, and p, then the Law of Mass 
Action states that: 


e S and E£ combine to form C at rate k se 
e C dissociates into S and FE at rate k_,c and into P and E at rate koc. 


Therefore, the rates of change of the four chemical species are 


= —kise+ k_ic, 

= = —kyse+ (k_1 + ka)e, 
= = kyse — (k_1 + ka)e, 
op = koc. 


Initially, we assume s(0) = so, e(0) = eo, p(0) = 0, and c(0) = 0, where ep is 
generally very small. Notice that once c is determined, then p is determined by 
direct integration; and p does not enter the first three equations. Thus, there 
are only three equations for s, e, and c. Furthermore, we instantly see that 
e’ +c =Oand s’+c +p =0, ore +cand s+c+p are constants for all ¢. 
Evaluating these conserved quantities at t = 0 gives the relations 


e+c=e€o, S+c+p= So. 
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time scale 


(Sy Co) 
s 


Figure 5.17 The sc phase plane for (5.25)—(5.26) showing the two nullclines 
(dashed) s' = 0 and c’ = 0, as well as the direction field. An orbit beginning 
at (S9,Co) rises steeply and rapidly to cross the c’ = 0 nullcline; there it is 
trapped in between the nullclines as ¢t approaches the origin, a stable node. To 
illustrate the effects, the figure has been expanded vertically; in an actual case, 
the nullclines lie much closer to the s axis. 


We can see that if eo is small, then c(t) is small, which makes sense chemically. 
These equations allow elimination of e and the reduction to a system of two 
nonlinear equations for s and c, 


ds 


a kyegs + (k_1 + kis)ec, (5.25) 
dc 
as kyeos — (ko + k_1 + kis)c. (5.26) 


We can easily perform a phase plane analysis to find the structure of the 

orbits in sc space. Refer to Figure 5.17. The nullclines are 

c= — (s nullcline), c= ——- (c nullcline). 
Both are Type 2 (hyperbolic) curves. By comparing denominators, it is clear 
that the s nullcline lies slightly above the c nullcline. The direction arrows in 
the three regions are easily found from the differential equations. The orbit 
increases rapidly in s, changing little, and then becomes trapped between the 
nullclines as it approaches the origin. 

We want to confirm analytically some of our deductions using the assump- 
tion that the initial enzyme concentration e9 is very small in such reactions; 
this means c(t) is small as well. Let’s make a transformation of the independent 
variable c(t) to a new independent variable y(t) = c(t)/eo. Then the c equation 
becomes 


d 
Sp = Pull — y)s — (ka + ha), 
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and the s equation becomes 


Comparing the last two equations we observe that s changes very slowly com- 
pared to c because of the small factor e9 on the right side of the s equation. 
Therefore, we can make the approximation that s is essentially a constant, 
s(t) & So, at early times on the first portion of the steep orbit (Figure 5.17); 
the formation of the complex is rapid. This type of assumption is called a 
quasi-steady state assumption, and it is common in complex, multiple chemical 
reactions when one of the reactions is very fast; it equilibrates quickly and can 
be ignored. Under this assumption the y equation behaves like a first-order 
autonomous equation, which can be handled by a simple phase line diagram. 
Its equilibrium is 


# kis 
= << — a sy constant, 
ky + ko + kis 
or 
* €0s k_1y +k 
c= ; K =———. 
K+s ky 


Finally, on this fast regime, the p equation states that the product is produced 


at rate koc* or 
koeos 


K+s 

This famous equation is called the Michaelis-Menten law in biochemistry. The 
approximations describe the initial phase of the enzyme reaction, which is on 
a very fast time scale. After this initial phase, when the orbit becomes trapped 
between the nullclines, the reaction is on a much slower time scale. There, 
the orbit is approximately equal to the nullcline. Figure 5.18 shows a generic 


Speed of the reaction = 


simulation of time series plots. 


EXERCISES 


1. In the SIR model analyze the phase plane diagram in the case r/a > N. 
Does an epidemic occur in this case? 


2. Referring to Figure 5.16, qualitatively sketch the shapes of the times series 
plots S(t), Z(t), and R(t) vs, t on the same set of axes when the initial 
point is Q. 


3. In a population of 200 individuals, 20 were initially infected with an 
influenza virus. After the flu ran its course, it was found that 100 indi- 
viduals did not contract the flu. If it took about 3 days to recover, what 
was the transmission coefficient a? What was the average time that it might 
have taken for someone to get the flu? 
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Figure 5.18 Time series plots of c(t) (dashed) and s(t) on two time regimes. 
The left plot shows the concentrations on a very fast time scale when s is 
approximately constant and c rapidly rises. The right plot shows the concen- 
trations on a slow time scale, when the orbit is between the nullclines; on this 
plot the fast time changes are invisible. 


4. Ina population of 500 people, 25 have a contagious illness. On the average it 
takes about 2 days to contract the illness and 4 days to recover. How many 
in the population do not get the illness? What is the maximum number of 
infectives that occurs? 


5. In a constant population, consider an SIS model where susceptibles 
become infected, and then become susceptible immediately after recov- 
ery. Assume an infection rate aSI and recovery rate rl. Write the model 
equations and reformulate the equations as a single differential for the 
infected class. Fully analyze the dynamics of the disease. Can you think of 
an example of such a disease? 


6. Beginning with the SIR model, assume that susceptible individuals are vac- 
cinated at a constant rate v. Formulate the model equations and describe 
the progress of the disease if, initially, there are a small number of infectives 
in a large population. 


7. (SIRS Model) Beginning with the SIR model, assume that recovered 
individuals can lose their immunity and become susceptible again after an 
average recovery period of time yu. That is, the rate recovered individuals 
become susceptible is wR. 


a) Draw a compartmental diagram. 

b) Formulate a two-dimensional system of equations for S and I. 

c) Find the two equilibria. 
) 


d) By sketching the nullclines and vector field, show that the disease-free 


equilibrium is unstable. Identify the type of equilibrium? 
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8. 


10. 
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e) Can you determine whether the nonzero equilibrium (the endemic 
state) is stable or unstable? What does it appear to be? 


Analyze an SIR disease model when susceptibles are removed from the 
population at a per capita rate py. Thus, 


dS 

eS Sa Ops 

a aSl — pS, 
I 

& =aSI—rl, 
dR 

—=rl S. 
7 ri + pb 


Proceed as in the SIR model, noting the differences in the dynamics. Hint: 
Note that the last equation is independent of the first two. 


(HIV) In a simplified model of HIV infection, let x be the population 
of susceptibles and y the population of those who are infected with HIV, 
but not AIDS. Suppose there is a constant supply 6b of susceptibles to the 
population, and suppose the natural death rate of both susceptibles and 
infecteds is yz; also, assume that those infected with HIV get AIDS at the 
rate cy and are thus removed from the HIV population. Finally, assume 


that the infection rate is ij 


e+ y’ 
or, the per capita rate of becoming infected is proportional to the fraction of 
infectious individuals. Draw a compartmental diagram for susceptibles and 
infectives showing the rates between them and derive the model equations. 
Show that there is a threshold value a* of a given by a* = 1 +c such that 
the infection dies out for a < a*, and for a > a* the infection becomes 
endemic. Verify this conclusion numerically using the values b = 1000, 
Ls = 0.03, c = 0.087 with a = 0.1 and 0.13. 


ax 


For each of the following: (a) Find the rates of the reactions and the 
dynamical equations for the concentrations of the chemical constituents. 
(b) Reduce the equations to the fewest number possible. (c) Sketch the 
phase line or phase plane diagram if appropriate. Note: X, Y, Z, W denote 
chemical species with concentrations x, y,z, w. Constituents A and B are 
assumes to be held at constant concentrations a and 0. 


a) X 4 oY. 


A+X "ex, ox "5 As 


A+xX ®ax, ox" a4 


d) 2X+Y %35X4+Z. 


+ X. 


Pe Rep 


11. 


12. 


13. 
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(Computational) In the Michaelis Menten equations, (5.25)—(5.26), take 
ky = 10°, k_y = 10°, ko = 103, so = 1073, €9 = 10-°, and Co = 0. Use 
software to numerically solve the problem over the time interval 0 < t < 
2(10)-*. 


If we modify an SIR model by considering births and deaths we obtain the 
dynamical equations 


S’ =pN-—aSI-pS, I'=aSI-rl—-pl, Ro =rl = pR. 
a) Show that the total population is the constant N. (This is valid because 
births and deaths are balanced.) 


b) Rewrite the first two equations by making a change of independent 
variables to x = S/N and y = al. In your equations use the constant 
Ro =aN/(r +p). 


c) Assume Ro > 1 in your equations in part (b), and investigate the 
dynamics. 


d) Draw a phase diagram and comment on the results. 


(SEI model) In this epidemic model there is an endemic, or latent, state 
E between the susceptible and infective states consisting of those who have 
contracted the disease but are not yet infectious. The model is 


S’=-aSI, E'’=aSI-kE, I'=keE. 
a) Draw a compartmental diagram and explain the model. 
b) Reduce the equations to two and draw a phase plane diagram. 


c) How does this model differ in behavior to that of an SI disease studied 
earlier. 


5.3.4 Malaria* 


When another organism is involved in the transmission of a disease, that organ- 
ism is called a vector. These types of diseases are not contagious, or spread by 
contact, such as in the flu, measles, or some sexually transmitted diseases. In 


the case of malaria, the mosquito is a vector in the transmission of malaria to 
different individuals, and the human is also a vector in transmitting the disease 
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among mosquitos; so, this is a criss-cross infection. Malaria affects more indi- 
viduals worldwide than any other disease, especially in tropical areas. Other 
vector diseases transmitted by mosquitos include West Nile virus, dengue and 
yellow fever, and filariasis. 

The malaria culprit, from the human point of view, is the female Anopheles 
mosquito. The infectious agent is a protozoan parasite that is injected into 
the blood stream by a mosquito when she is taking a blood meal, which is 
necessary for the development of her eggs. The parasite develops inside the 
host and produces gametocytes which then can be taken up by another biting 
mosquito. 

We have to make some highly simplifying assumptions to obtain a tractable 
model. We present the classic model of R. Ross, developed in 1911, and modified 
by G. Macdonald in 1957. Sir Ronald Ross is given credit for first understanding 
and modeling the complex malarial cycle, a feat for which he was awarded the 
Nobel Prize.!! 

We assume that human victims have no immune system response and 
that they eventually recover from the disease without dying. We assume the 
mosquito and the human populations are approximately constant. Thus, the 
disease dynamics is fast compared to the dynamics of either hosts or mosquitos. 
Let Hr and Mr be the total number of hosts (humans) and total number of 
mosquitos, respectively, in a fixed region; both are assumed to be constant. 
Furthermore, let 


H(t) = number of infected hosts (humans) 


M(t) = number of infected mosquitos 


First we consider the hosts. The rate that a human gets infected depends 
on the number of mosquitos, the biting rate a (bites per time), and b, the 
fraction of bites that lead to an infection of a human, and the probability of 
the mosquito encountering a susceptible human. The fraction of susceptible 
humans is (H; — H)/Hr. Finally, we assume that the per capita recovery rate 
of infected humans is r, where 1/r is the average time to recovery. Therefore, 
the rate equation for H is 


dt Hr 
which is the infection rate minus the recovery rate. Notice that the infection 


rate is proportional to the product of susceptible hosts and infected mosquitos, 


™ See R. M. Anderson & R. M. May, 1991, Infectious Diseases of Humans, Oxford 
University Press, Oxford UK. This book is the standard reference for diseases, both 
micro- and macroparasitic. 
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case 1 case 2 


Figure 5.19 The two cases for the malaria model: the nullclines cross only 
at the origin, and the nullclines cross at the origin and at a nonzero state. The 
second case will occur only when the slope of the mosquito nullcline exceeds 
the slope of the host nullcline at the origin, or B/u > r/a. 


which should remind the reader of the simple SIR model studied earlier. The 
rate that mosquitos become infected from biting an infected host depends on 
a and c (the fraction of bites by an uninfected mosquito of an infected human 
that causes infection in the mosquito). If yz is the per capita death rate of 
infected mosquitos, then 


a = ac(Mr — M)— — pM, 
and H/Hr is the probability of encountering an infected human. Note that 
the infection rate is jointly proportional to My — M, the number of susceptible 
mosquitos, and the number of infected hosts, again a reminder of an SIR model. 
Implicit in our assumptions is that birth rates of mosquitos compensates for 
the death because the total population is constant. 
We can immediately simplify these equations by introducing 


H M 
— m= — 
Hr’ Mr’ 


which are the fractions of the populations that are infected. Then the governing 
equations become 


dh Mr 
d 
= = ach(1 — m) — pm. (5.28) 
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Figure 5.20 Orbits in the two cases. In case 1 the origin is a stable node 
and the disease epidemic dies out. In case two, the origin is unstable and the 
disease approaches an endemic state. 


Then the equations are 


“ Te ee (5.29) 
d 
= = Bh(1 —m) — pm. (5.30) 


We can analyze this geometrically in the phase plane in the usual way. 
Setting the right sides equal to zero gives the nullclines 


h 

m= Cea, (h nullcline) (5.31) 
h 

m= ; z Bh (m nullcline) (5.32) 


Note that h = m = 0 is always an equilibrium. Also, the A nullcline is concave 
up with a vertical asymptote at h = 1; the m nullcline is concave down with a 
horizontal asymptote at m = 1. The two possibilities are shown in Figure 5.19. 


There will be a nonzero equilibrium only when these curves cross. If there is 
a nonzero equilibrium, then the slope of the m nullcline must be steeper than 
the slope of the h nullcline at h = 0. Calculating these slopes from (5.31)—(5.32), 
respectively, we get 


‘ (A nullcline) 
m'(0) = —. (m nullcline) 
Therefore, for a nonzero equilibrium, we must have the condition 


B 
feel 5.33 
F > (5.33) 


QI 
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We show that this nonzero equilibrium is asymptotically stable, which 
means the infectious populations approach a nonzero endemic state. First, how- 
ever, let’s interpret this result (5.33) in terms of the actual parameter values. 
We can rewrite (5.33) as 


Mr 
ac abst 
a ar >1. 
bt r 


The first factor is the rate of infection of mosquitos (ac) times their aver- 
age lifetime (1/1). The second factor is the rate of infection of human hosts 
(abMr/Hr) times the average length of infection (1/r). 

We can easily check the stability of the nonzero equilibrium by sketching the 
direction field. Or, we can approach this analytically by finding the equilibrium 
and checking the Jacobian matrix. Setting (5.31) equal to (5.32) and solving 
for h gives 


«_ a8 — pr 
~ Br +a)’ 
Then, 
» _ a6 — pr 
alu + BY 


Notice that this is a viable equilibrium only if the numerator is positive, which 
is the same as the condition (5.33). Otherwise it is not viable and the origin, 
(0,0), is the only equilibrium. The Jacobian matrix at an arbitrary (h,m) is 
easily 
—am — 1-h 
(hy) = ( am—r at ie 


B(l—m) —Bh-p 


roo 4) 


The trace is negative in both cases. The determinant ur — af is positive when 
condition (5.33) holds, and negative when it does not hold. Therefore, the 
origin (extinction of the disease) is asymptotically stable when it is the only 


Clearly 


equilibrium, and it is unstable when a nonzero equilibrium exists. 
For the nonzero equilibrium 


Ithtym*) = ( —am*—r a(1—h*) i: 


B(L—m*) —Bh* — ps 


The trace is negative and 


det J(h*,m*) = (am* + r)(Bh* + pw) — aB(1 — m*)(1 — h*) 
=a —pur>0, 
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Table 5.1 Sample parameters 


Parameter Name Sample Value 
Mr/Hr population ratio 2 
a biting rate 0.2—0.5 per day 
b effective bites infecting humans 0.5 
c effective bites infecting mosquitos 0.5 
r recovery rate 0.01—0.05 per day 
LL mortality rate 0.05—-0.5 per day 


by condition (5.33), and after considerable simplification. Thus, (h*,m*) is 
asymptotically stable. 

To give some idea of parameter values used in computation, we list a sample 
set in Table 5.1. 


EXERCISES 


1. (Malaria) In this exercise develop and analyze a simplified version of the 
malaria model under the condition that r is much less that p. 


a) Beginning with (5.27)—-(5.28), nondimensionalize these equations by 
rescaling time by taking 7 = yt. Obtain 


dh 


— =Am(1—h)-«h, 
dt 
d 
all = nh(1—m)—m, 
dr 
where 
r ab Mr ac 
e=- r — ee =—_— 
ue Ar a 


b) Assuming ¢ is very small, neglect the ch term in the host equation and 
draw the phase portrait. Include the equilibria, nullclines, direction 
field, and a local stability analysis for the equilibria. 


c) For the simplified dimensionless model in part (b), with the values 
given in Table 5.1, specifically, a = 0.5, r = 0.01, and w = 0.5, use 
a numerical method to draw time series plots of h and m for various 
initial initial conditions. 


2. (Schistosomiasis* ) Schistosomiasis is a macroparasitic disease of humans 
caused by trematode worms, or blood flukes. Trematodes are a class of 
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Figure 5.21 Diagrammatic life cycle of schistosome parasites in humans. 


flatworms in the phylum Platyhelminthes, or helminths. Schistosomiasis 
is highly prevalent in tropical areas, and it is estimated that hundreds of 
millions of people suffer from it; it is second only to malaria. The life cycle of 
the parasite is complicated and involves a definitive host (humans), where 
maturity and reproduction occur, and a secondary host (e.g., snails), in 
which the intermediate larval stage develop into infectious larva (cercaria) 
that are shed and then penetrate, or are ingested, by the definitive host, 
completing the cycle. Figure 5.21 is a diagrammatic flow chart summarizing 
the process!”. Here we consider a simplified model tracking the number of 
infected snails J and the average worm burden m in the host, which is the 
total number of mature worms divided by the constant number of hosts. 
The dynamics for the average number of mature parasites in a host is 
dm I 


call es Es 5.34 
E+ an (5.34) 


where a is the rate that infected snails produce the free living stage larva 
that infects the host (through ingestion or skin penetration). The factor 
I/N is the fraction of snails infected, and pu is the per capita mortality rate. 
The dynamics for the number of infected snails is 

dl am? 


i (5.35) 


Here, 6 represents the per capita mortality rate of the infected snails, and 
N —T is the number of susceptible snails. C(m) is proportional to the rate 


12 See R. M, Anderson and R. M May, Ibid. 
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of production of eggs by (paired) female adult worms; the latter includes 
the rate of hatching of the eggs that eventually produce the infecting, free- 
living larva. Therefore, C’ contains several rates in the life cycle and perhaps 
complicated dependence on the fraction of paired females. 


a) Find and draw generic plots the two nullclines in the model. 


b) Treat a as a varying parameter, with all the other parameters fixed. 
Confirm graphically that for small values of a there is only a single 
equilibrium at (0,0). Then, as a increases, the slope of the m nullcline 
decreases until it is tangent to the sigmoid curve and there is a bifur- 
cation at a value a = a*. As a increases further, show there are two 
nonzero equilibria. 


c) Sketch generic phase plane diagrams for the three cases a < a*, a = a*, 
and a > a*. On your diagrams indicate the nullclines, equilibria, and 
directions of the vector field. 


d) Based upon your plots in (c), find the stability of the equilibria in each 
case. 


e) Draw a bifurcation diagram for equilibrium values of m versus the 
parameter a. In a few sentences comment on the interpretation of the 
bifurcation diagram. 


f) Find equations that determine the bifurcation point (a*,m*). 


g) Comment on how a health organization might introduce measures to 
decrease the value of a. 


5.4 Advanced Techniques 
5.4.1 Periodic Orbits 


We noted a number of times that an exceptional case occurs in the linearization 
procedure near a critical point: if the associated linearization for the perturba- 
tions has a center (purely imaginary eigenvalues) at (0,0), then the behavior 
of the nonlinear system at the critical point is undetermined. This suggests 
that the existence of a periodic solutions (also called cycles or oscillations), 
for a nonlinear systems is not easily decided. In this section we discuss special 
cases when we can be assured that periodic solutions do not exist, and when 
they do exist. The presence of oscillations in physical and biological systems 
often represent important phenomena, which is why such solutions are of great 
interest. 
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We first state two negative criteria for the nonlinear system 


where f and g are continuously differentiable functions. 


1. (Equilibrium Criterion) If the nonlinear system (5.36—5.37) has a cycle, 
then the region inside the cycle must contain an equilibrium. Therefore, if 
there are no equilibria in a given region, then the region contains no cycles. 


2. (Dulac’s Criterion) Consider the nonlinear system (5.36—5.37). In a given 
region of the plane, if there is a function 6 = 8(x,y) for which 


0 0 
9, BP) + By 29) 


is of one sign (strictly positive or strictly negative) entirely in the region, 
then the system cannot have a cycle in that region. 


We omit the proof of the equilibrium criterion (it may be found in the 
references), but we can give the proof of Dulac’s criterion because it is a simple 
application of Green’s theorem,!* encountered in multivariable calculus. 

The proof is by contradiction, and it assumes that there is a cycle of period 
p given by « = a(t), y = y(t), O < t < p, lying entirely in the region 
and represented by a simple closed curve C. Assume it encloses a domain R. 
Without loss of generality suppose that 


0 0 
9, OF) 4 By (79) > 0. 


Then, to obtain a contradiction, we make the following calculation using 
Green’s theorem. 


0 0 
o< ff (Zen+ Zn) aa= [soar +ofay 
= [ (Bae! at + ofyfaty = ["(—agpat + of gt) =o, 
0 0 


the contradiction being 0 < 0. Therefore the assumption of a cycle is false, and 
there can be no periodic solution. 


13 Green’s theorem: For a nice region R enclosed by a simple closed curve C we 
have [., Pda + Qdy = J Jn(Qz — Py)dA, where C is taken counterclockwise. The 
functions P and @ are assumed to be continuously differentiable in a open region 
containing R. 
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Example 5.11 


The system 
a=lt+y, y =2-yt+ay 


does not have any critical points because x’ can never equal zero; so this system 
cannot have cycles. 


Example 5.12 


Consider the system 


/ 


g=a+e°—-Qy, yf =—-3r+y’. 
Then 


6) 0 3 0 

—jg=— —2 —(—3 8) = 14327 + 3y? > 0 
0! agit te y) + a( x+y”) + 32° + 3y° > 0, 
which is positive for all x and y. Dulac’s criterion implies there are no periodic 
orbits in the entire plane. Note here that 6 = 1. 


fe) 
Ba! t 


One must be careful in applying Dulac’s criterion. If we find that 


0 0 
9, OF) an By 29) >0 


in, say, the first quadrant only, then that means there are no cycles lying entirely 
in the first quadrant; but there still may be cycles that go out of the first 
quadrant. 

Sometimes cycles can be detected easily in a polar coordinate system. Pres- 
ence of the expression x? + y? in the system of differential equations often 
signals that a polar representation might be useful in analyzing the problem. 


Example 5.13 


Consider the system 


a =y+a2(1—27?—-y*) 

y =-2+y(1—2?—y’). 
The reader should check, by linearization, that the origin is an unstable spiral 
point with clockwise rotation. But what happens beyond that? To transform 


the problem to polar coordinates x = rcos@ and y = rsin@, we note that 
2 Y 


roe+y’, tand= =. 
x 
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Taking time derivatives and using the chain rule, 


/ / 
zy’ — yx 
rr =a +yy’, (sec? 0)0’ = ee 


We can solve for r’ and 6’ to get 


r’=2'cosé+y'sind, OW = eoe= tant 

? r * 
Finally we substitute for x’ and y’ on the right side from the differential equa- 
tions to get the polar forms of the equations: r’ = F(r,6), 6’ = G(r, @). Leaving 
the algebra to the reader, we finally get 


r =r(1—r?), 


= -1. 


By direct integration of the second equation, 6 = —t+C;, so the angle 0 rotates 
clockwise with constant speed. Notice also that r = 1 is a solution to the 
first equation. Thus we have obtained a periodic solution, a circle of radius 
r = 1, to the system. For r < 1 we have r’ > 0, so r is increasing on orbits, 
consistent with our remark that the origin is an unstable spiral. For r > 1 we 
have r’ < 0, so r is decreasing along those orbits. Hence, there is a limit cycle 
that is approached by orbits from its interior and its exterior. Figure 5.22 shows 
the phase diagram. 


The Poincaré—Bendixson Theorem 


To sum up, through several examples we observed various nonlinear phe- 
nomena in the phase plane, including equilibria or critical points, orbits that 
approach equilibria, orbits that go to infinity, periodic solutions or cycles, and 
orbits that approach cycles. What have we missed? Is there some other com- 
plicated orbital structure that is possible? The famous Poincaré—Bendixson 
theorem! states that the answer is no. The dynamical possibilities for orbits 
of a’ = f(x,y), y’ = g(a, y), f,g continuously differentiable, are limited. 


Theorem 5.14 


(Poincaré—Bendixson theorem) If an orbit is confined to a closed bounded 
region in the plane, then the orbit is a critical point or approaches a critical 
point as t + +00, or the orbit is a cycle or approaches a cycle as t > +-oo. The 
same result holds true as t — —oo. 

M4 Henri Poincaré (1854-1912) was one of the great contributors to the theory of 


differential equations and dynamical systems; I. O. Bendixson (1861-1935) was a 
well known Swedish mathematician. 
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1.5F limit cycle 


Figure 5.22 Limit cycle. The interior orbits approach the limit cycle clock- 
wise, and the exterior orbits approach it clockwise as well. In this case we say 
it is an asymptotically stable limit cycle. 


This theorem is proved in advanced texts. It is important to note that the 
theorem is not true in three dimensions or higher, where orbits for nonlinear 
systems can exhibit bizarre behavior. For example, orbits in three dimensions 
can approach sets of fractal dimension (strange attractors) showing chaotic 
behavior. In the next section we will see important applications of this theorem. 


EXERCISES 


1. Does the system 


ve =x2-—y-ayr?+y?, 
y=oty-yVet+y, 


have periodic orbits? Does it have limit cycles? 


2. Show that the system 


has no periodic solutions. 
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5.4 


. Show that the system 


gz’ =a2+23 —2Qy, 
y =y? — 32, 


has no periodic solutions. 


. Show that periodic orbits, or cycles, for the dynamical system 


/ 


a=y, yf =—ky-V'(2) 


are possible only if k = 0. 


. Consider the system 


v =2(P—-—ar+by), y' =y(Q-cy+drz), 


where a, c > 0. Show that there cannot be periodic orbits in the first 
quadrant of the xy plane. Hint: Take 6 = (xy)~'. 


. Assume f and g are continuously differentiable everywhere and suppose the 


nonlinear system 2’ = f (x,t), y’ = g(x, t) has a cycle with a single critical 
point inside. One can prove the critical point cannot be a saddle point. 
Why do you think this true? Convince yourself by drawing a diagram. 


. Show that the orbits of the system 


x! = o(a° — 249), 
y = y(22° —y°), 
are given by x? + y? = 3Czy, where C is an arbitrary constant, and 


sketch several orbits in the phase plane. The curves are called the folia 
of Descartes. 


. In Example 5.13 solve the radial equations for r and 6 exactly to find the 


orbits. Consider each case. 


. A system 


ori. 
g( 
is called a Hamiltonian system if there is a function H(z, y) for which 


f = H, and g = —H,. The function 4 is called the Hamiltonian. Prove 
the following facts about Hamiltonian systems. 


wy) 
Lz, 


xv 
y= y); 


a) If fe + g, = 0, then the system is Hamiltonian. (Recall that f; + gy is 
the divergence of the vector field (f,g).) 
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b) Prove that along any orbit, H(x,y) = constant, and therefore all the 
orbits are given by H(x,y) = constant. 


c) Show that if a Hamiltonian system has an equilibrium, then it is not a 
source or sink (node or spiral). 


d) Show that any conservative dynamical equation x” = f(x) leads to 
a Hamiltonian system, and show that the Hamiltonian coincides with 
the total energy. 


e) Find the Hamiltonian for the system 2’ = y,  y! = x — x”, and plot 
the orbits. 


10. In a Hamiltonian system the Hamiltonian given by H(a,y) = x? + 4y?. 
Write the system and determine the equilibria. Sketch the orbits. 


11. A system 


a’ = f(z,y) 
y' = g(x,y), 
is called a gradient system if there is a function G(z, y) for which f = G, 


and g = Gy. 


a) If fy — 92 = 0, prove that the system is a gradient system. (Recall that 
fy — Gx is the curl of the two-dimensional vector field (f,g); a zero curl 
ensures existence of a potential function on nice domains.) 


b) Prove that along any orbit, (d/dt)G(a,t) > 0. Show that periodic orbits 
are impossible in gradient systems. 


c) Show that if a gradient system has an equilibrium, then it is not a 
center or spiral. 


d) Show that the system 2’ = 97?—10ry?, y’ = 2y—10xy is a gradient 
system. 


e) Show that the system 2’ = siny, y’ = «cosy has no periodic orbits. 


12. (Chemical kinetics) A chemical reaction, where two molecules of X react 
with a molecule of Y to produce the product X2Y, proceeds in two steps, 


X+Y 5 XY, 
X4exXY 3 MOY. 


By the law of mass action, the rates of these reactions are r; = axy and 
rg = Baz, where x, y, and z denote the concentrations of X, Y and XY, 
respectively, and a and £ are the rate constants with 26 > a. 
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a) Show that the concentrations change according to 


dx dy dz 
a —ary — Buz, de ORY) ae axy — Buz. 


b) Show that 2 — 2y— z= C, a constant. 


c) Initially, assume «(0) = 2y(0). Show that the system can be reduced 
to two equations 


i= Op apse 


d 
dt dt 


Y_ 
= = —-ary. 


d) In the zy phase plane, describe the kinetics of the reaction. 


13. (a) Describe fully the dynamics of the polar system r’ = r? — 3r? + 2r, 
6’ =1. (b) Write the system in rectangular coordinates. 


14. Sketch the phase plane diagram for each equation. Hint: You might check 
if the system is Hamiltonian or gradient. 


a) a =y? +22y, y = 27 + Qay. c) av =a? —-2Qry, y! = y? — 2zy. 


en. . 
d) a’ =sin“ xsiny, 


b) 2? — 2zy, y/ = y? — 27. y’ = —2sinx cos x cos y. 


5.5 Bifurcations 


In Chapter 1 we examined the structure of a single autonomous differential 
equation xz’ = f(x,h), where h is a parameter. The equilibria z = x, satisfy 
the equation f(a-,h) = 0, so they depend on the parameter h. As h varies, 
the equilibria and their stability properties vary as well, and we faced the 
phenomenon of bifurcation. In Chapter 4 we saw that two-dimensional linear 
systems depending on parameters have similar issues, and they have a much 
richer structure than their one-dimensional counterparts. Here we examine a 
nonlinear system, which exposes yet another bifurcation issue. 


Example 5.15 


Consider the model 
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In an ecological context, we can think of this system as a predator—prey 
model. The prey (x) grow logistically and are harvested by the predators (y) 
with a Holling type II rate. The predator grows logistically, with its carrying 
capacity depending linearly upon the prey population. The horizontal, y null- 
clines, are y = x and y = 0, and the vertical, or x nullcline, is the parabola 
y = (3 — %2) (c +1). The equilibria are (1,1), and (4,0). The system is not 
defined when « = 0 and we classify the y-axis as a line of singularities; no 
orbits can cross this line. The Jacobian matrix is 


Haw = (4 #ya(3 Sg ae 
Gx Yy 


ae te 


Evaluating at the equilibria yields 


14,0) =(~% ), 10,1) =( 8 >). 


It is clear that (4,0) is a saddle point with eigenvalues r and —2/3. At (1,1) 
we find trJ = + —rand det J = ar > 0. Therefore (1,1) is asymptotically 
stable if r > + and unstable if r < =: So, there is a bifurcation, or change, at 
= + because the stability of the equilibrium changes. For a large predator 
growth rate r there is a nonzero persistent state where predator and prey can 
coexist. As the growth rate of the predator decreases to a critical value, this 
persistence goes away. What happens then? Let us imagine that the system is 
in the stable equilibrium state and other factors, possibly environmental, cause 
the growth rate of the predator to slowly decrease. How will the populations 
respond once the critical value of r is reached? 

Let us carefully examine the case when r < aor Consider the direction of 
the vector field on the boundary of the square with corners (0,0), (4,0), (4,4), 
(0,4). See Figure 5.23. On the left side (2 = 0) the vector field is undefined, and 
near that boundary it is nearly vertical; orbits cannot enter or escape along that 
edge. On the lower side (y = 0) the vector field is horizontal (y’ = 0, x’ > 0). 
On the right edge (a = 4) we have x’ < 0 and y’ > 0, so the vector field points 
into the square. And, finally, along the upper edge (y = 4) we have x’ < 0 and 
y’ < 0, so again the vector field points into the square. The equilibrium at (1, 1) 
is unstable, so orbits go away from equilibrium; but they cannot escape from the 
square. On the other hand, orbits along the top and right sides are entering the 
square. What can happen? They cannot crash into each other! (Uniqueness.) 
So, there must be a counterclockwise limit cycle in the interior of the square (by 
the Poincaré—Bendixson theorem). The orbits entering the square approach the 
cycle from the outside, and the orbits coming out of the unstable equilibrium 
at (1,1) approach the cycle from the inside. Now we can state what happens as 
the predator growth rate r decreases through the critical value. The persistent 
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basin of 
attraction 


(0,0) 


Figure 5.23 A square representing a basin of attraction. Orbits cannot escape 
the square. 


state becomes unstable and a small perturbation, always present, causes the 
orbit to approach the limit cycle. Thus, we expect the populations to cycle near 
the limit cycle. A phase diagram is shown in Figure 5.24. 


In this example we used a common technique of constructing a region, called 
a basin of attraction, that contains an unstable spiral (or node), but orbits 
cannot escape the region. In this case there must be a limit cycle in the region. 
A similar result holds true for annular type regions (doughnut type regions 
bounded by concentric simple close curves); if there are no equilibria in an 
annular region R and the vector field points inward into the region on both the 
inner and outer concentric boundaries, then there must be a limit cycle in R. 


1. Describe the bifurcations that occur in the system 
xv =ex—y, yi =at+ey 
as € varies from —0.2 to 0.2. Include plots in your answer. 


2. Analyze the dynamics of the system 


for different positive values of c. Draw phase diagrams for each case, illus- 
trating the behavior. 
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: 


0.57 


Figure 5.24 Phase diagram showing a counterclockwise limit cycle. Curves 
approach the limit cycle from the outside and from the inside. The interior 
equilibrium is an unstable spiral point. 


3. A predator-prey population model is governed by the dynamics 


a 


eg =-“2+ cry, y’ = 4y (1- 2) - 2ay, 


where K is the carrying capacity of the predator. As K slowly increases 
from 0.5 to 4.0, determine and describe the bifurcations that occur in the 
model. 


4. Consider the system 
x =ax+y—a2(z* +y’), 
yi =—2+ay—y(2* +y"), 
where a is a parameter. (a) Show that the system becomes 
r=r(a—r’), @=-1 


in polar coordinates. (b) If a < 0 show (0,0) is a stable spiral. (c) If a > 0, 
show that (0,0) is an unstable spiral. (d) Show that there is a limit cycle 


at r= Va. 
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This is an example of a Hopf bifurcation. As the parameter increases from 
negative to positive, the eigenvalues pass across the imaginary axis in the 
complex plane, signaling the birth of a limit cycle. 


5. Let P denote the carbon biomass of plants in an ecosystem and H the 
carbon biomass of herbivores. Let ¢ denote the constant rate of primary 
production of carbon in plants due to photosynthesis. Then a model of 
plant—herbivore dynamics is given by 


P'=$-aP—bdHP, 
H! = cbHP —cH, 


where a, b, c, and € are positive parameters. 


a) Explain the various terms in the model and determine the dimensions 
of each constant. 


b) Find the equilibrium solutions. 


c) Analyze the dynamics in two cases, that of high primary production 
(¢ > ac/eb) and low primary production (¢ < ac/eb). Determine what 
happens to the system if the primary production is slowly increased 
from a low value to a high value. 


6. Consider the system 


Show that a bifurcation occurs at h = 0 because of a change in dynamics. 
Plot, for h > 0, the equilibrium values of x versus fh and label the branches 
as stable or unstable. 


7. Consider two competing species where one of the species immigrates or emi- 
grates at constant rate h. The populations are governed by the dynamical 
equations 


where a,b > 0. 


a) In the case h = 0 (no immigration or emigration) give a complete 
analysis of the system and indicate in a, b parameter space (i.e., in the 
ab plane) the different possible behaviors, including where bifurcations 
occur. Include in your discussion equilibria, stability, and so forth. 
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10. 


11. 


12. 
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b) Repeat part (a) for various fixed values of h, with h > 0. 


c) Repeat part (a) for various fixed values of h, with h < 0. 


. Determine the nature of each equilibrium of the system 


x’ = 4x” — a, 


, Y) 2 
=-= +4 
y a I 


and show how the equilibria change as the parameter a varies. 


. Give a thorough description, in terms of equilibria, stability, and phase 


diagram, of the behavior of the system 


ve =y+(1—-2)(2—-~2), 
! 2 
Y=y-—ar, 
as a function of the parameter a > 0. 


Consider the nonlinear system 


gz =1-(a+1)r+27y, 
y =ax—z*y, a>O. 
a) Find the equilibrium and the Jacobian matrix in the first quadrant. 
b) Show the equilibrium is stable for a < 2 and unstable for a > 2. 
c) Use a numerical algorithm to detect a limit cycle when a = 3. 
The populations of two competing species x and y are modeled by the 


system 


/ 


ve =(K-—2)r- xy, 
y' = (1— 2y)y — ay, 


where K is a positive constant. In terms of K, find the equilibria. Explain 
how the equilibria change, as to type and stability, as the parameter Ky 
increases through the interval 0 < K < 1, and describe how the phase 
diagram evolves. Especially describe the nature of the change at K = 4. 


(van der Pol’s equation) In an RCL circuit, replace Ohm’s law, V = RI, 
by a nonlinear function V = f(J) of current. 


a) Show that the circuit equation becomes LI” + f’(I)I' + $I = 0. 
b) Specifically, show that if f(2) = bI? — al, then 


1 
LI" + (361? = a)l’ + gi =0. 


13. 


14. 
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c) Define new independent and dependent variables defined by r = VLCt, 
x =I/p, where p = \/a/(b), and show that the previous equation can 


C 
x” + p(x? —1)e' +2 =0, p= aye. 


This is the famous van der Pol equation for a RCL circuit with a active 


be written 


resistance. 


d) Reduce the van der Pol equation to a system and show if 0 < pp < 2 
the origin is an unstable spiral, and if 4 > 2 it is an unstable node. 


e) Take the case 4 = 1 and use software to numerically show that the 
van der Pol equation has a limit cycle. Hint: Use the initial conditions: 
(0) = 1, y(0) = —2; x(0) = 2, y(0) = 0; x(0) = 0.25, y(0) = 0. 


(Chaos) Chaos is a phenomenon where small changes in the initial condi- 
tions or parameters in the problem cause dramatic, unpredictable changes 
in the solution. It is not randomness, but a type of instability in a deter- 
ministic system. Consider a special case of the Duffing equation 


z"+a'—-2+2°=Fcost, £2(0)=1, 2'(0)=0, (F =0.8), 


which governs a damped, nonlinear spring forced by a periodic source. (a) 
Formulate the equation as a system and use software to sketch the orbit 
in the phase plane for 0 < t < 500. (b) Repeat the same calculation for 
F = 0.75. Observe the dramatic change in the solution, even though the 
values of F are close. For F = 0.8 the orbits wanders seemingly randomly 
around the phase plane, exhibiting the phenomenon of chaos. (c) Repeat 
the calculation for F = 0.8 with initial conditions z(0) = 1.1, 2’(0) = 0. 
Observe a similar dramatic change. 


(Macroparasites) In Exercise 2 of Section 5.3 we examined a helminth par- 
asite infection by tracking the average worm burden in a host and the num- 
ber of infected secondary hosts (snails). Now consider a different model of 
a helminth infection that tracks mature worms in the host and the larval 
population. Let LE be the number of larval parasites in the environment and 
M the number of mature parasites in the hosts. The equations are 


dL dM 


where WN is the total number of hosts, 6 is the larval per capita birth rate 
at which adults produce larva, v is the per capita larval death rate, p is 
the per capita parasite death rate, and A is the force of infection. Interpret 
this model and give a standard phase plane analysis, sketching the phase 
diagram in the case that an epidemic breaks out. 
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15. (Chemical kinetics) The system 
/ 1 2 / 1 2 
we =1—(at+ jet jay, yo =ax—7a'y, a> 0, 


represents the kinetics of a reaction where the chemical species undergo 
oscillations, with x, y > 0. 


a) Show that the only critical point is (1,4a) and find the eigenvalues of 
the linearization at that point. 


b) Classify the type and stability of the critical point as it depends on a. 
c) At what critical value of a is there a bifurcation? 


d) Plot the orbits for values of a slightly above and below the critical 
value. 


e) Indicate through calculations that a limit cycle is born as a passes 
through the critical value. This is another example of a Hopf bifurca- 
tion. See Exercise 4. 


16. Consider the nonlinear system 2’! = 27+ y, y’ = x—y+t+h, where h isa 
real parameter. (a) Find all the critical points. (b) Compute the Jacobian 
matrix at each critical point. (c) Describe the bifurcation(s) in the system. 


17. Consider the system 
v=y, yo =-cy—2(1—-2),c>2. 


By analyzing the phase plane diagram for x > 0, show that there must be 
an orbit connecting the two critical points (1,0) and (0,0) as t goes from 
—co to +00. 


18. Use the Poincaré—Bendixson theorem to show that the system 


a’ =a-y-2", y=rty—y’, 
has a periodic solution. Hint: Show the system has a square as the basin 
of attraction. 


19. For what value of the parameter a does the following system undergo a 
Hopf bifurcation? 


xg = 2°(1—2) — xy, y =ay—4. 
a 


6 


Computation of Solutions 


The fact is that most differential equations cannot be solved with simple ana- 
lytic formulas. Therefore we are interested in developing methods to approxi- 
mate solutions. An approximation can be a formula, or it can arise as a data 
set or plot obtained by a computer algorithm. The latter forms the basis of 
modern scientific computation, and it may be the most useful topic in this 
book for future scientists and engineers. 

This chapter provides a very brief account of three methods: the Euler 
method, the modified Euler method, and the fourth-order Runge-Kutta method. 
There is a concise discussion of the errors encountered in using these methods. 
The exercises require access to a computer algebra system or an advanced sci- 
entific calculator. 


6.1 Iteration* 


In this optional first section we introduce the notion of recursion formulas. We 
review Newton’s method and fixed point iteration for finding roots of algebraic 
equations, and then we expand the idea to differential equations and intro- 
duce an iterative procedure called the method of successive approximations, 
or Picard’s method (E. Picard, 1856-1941), that leads to a recursive analytic 
formula that, when applied over and over, gives an approximate formula for 
the solution to an initial value problem. 
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From calculus we learn that Newton’s method is an iterative procedure 
that approximates a root of the algebraic equation f(t) = 0. Newton’s method 
is defined by the recursive equation 


f (te) 

f'(te)’ 
where to is a prescribed, first approximation to a root. If to is sufficiently close 
to the actual root and other conditions hold, which we do not discuss, then 
the successive approximations t1, tz, t3,..., computed by the recursion formula 


teri =tk— k =0,1,2,..., 


converge rapidly to the root. It is clear from the formula that the method has 
difficulties near points where f’(t) = 0. 

Picard’s method is adapted from another classical iterative method, called 
the fixed point method. It is used to approximate solutions of nonlinear 
algebraic equations in the form t = g(t). 


Example 6.1 


(Fixed Point Iteration) Consider the problem of solving the nonlinear alge- 
braic equation 
t = cost. 


Graphically, it is clear that it is a unique solution because the curves y = t 
and y = cost cross at a single point between 0 and 7/2. Analytically we can 
approximate the root by making an initial guess tg near the root and then 
successively calculate better approximations via 


tra41 = cost, for k=0,1,2,... 


For example, if we choose tg = 0.9, then tj = cosa = cos(0.9) = 0.622, 
to = cost; = cos(0.622) = 0.813, t3 = costz = cos(0.813) = 0.687, ts = 
cost3 = cos(0.687) = 0.773, ts = cost, = cos(0.773) = 0.716,.... Thus we 
have generated a sequence of approximations 0.9, 0.622, 0.813, 0.687, 0.773, 
0.716, .... If we continue the process, the sequence converges to some t*, which 
is the solution to t = cost. To three decimal places, t* = 0.739. 


The method of fixed point iteration can be applied to general algebraic 
equations of the form 


t = g(t). 
The iterative procedure is 


ten =9(te); B=0,1,2, 05 


and it will converge to a root t* provided |g’(t*)| < 1 and the initial guess to 
is sufficiently close to t*. The conditions stipulate that the graph of g cannot 
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be too steep (its absolute slope at the root must be bounded by one), and the 
initial guess must be sufficiently close to the root. 

This fixed point iteration idea for algebraic equations can be expanded to 
find approximate solutions to first-order differential equations, and systems of 
first-order equations. Consider the initial value problem 


ave) {eaten 


The first step is to turn this problem into an equivalent integral equation by 
integrating the differential equation from to to ¢ and using the fundamental 
theorem of calculus. Easily this gives the equivalent problem 


x(t) = xo +f f(s, 2(s))ds. (6.1) 


Now we define Picard iteration, a type of fixed point iteration. It is based 
on the integral equation formulation (6.1). The iterative scheme is 


rra(t) =a0+ f f(s,xe(s))ds, k=0,1,2,..., (6.2) 


where where we start the procedure with xo(t) = xo, a prescribed initial approx- 
imation. Then we generate a sequence x1(t), xo(t), x3(t),... of iterates, called 
Picard iterates, that under certain conditions converge to the solution of the 
original initial value problem, or equivalently, to (6.1). 


Example 6.2 


Consider the linear initial value problem 
gv =2t(1+z2), 2(0)=0. 
Then the iteration scheme is 
Crti(t) = [ 2s(1+24(s))ds, k=0,1,2,..., 


Take xo(t) = 0, the initial condition; then 


“ers [ 28(1 +0)ds = #2. 


Then : : 
1 
x2(t) = | 2s(1+ 21(s))ds = i 2s(1+s7\ds = ¢t? + 5 
0 0 
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Next, 
, : re a ee 
x3(t) =| 2s(1 + x9(s))ds =| 2s(14+s5°+—=s*)ds =t* + = 4+ <2. 
0 0 2 2 6 
In this manner we generate a sequence of approximations of the solution to the 
IVP. In this case one can verify that the analytic solution to the IVP is 
x(t) = oF a1. 
The Taylor series expansion of this exact solution is 
oe 34? a) 1 4 1 6 1 Qn 
a(t)=e —1l=t +5¢ + ¢t sai a epee eA 


and it converges for all t. Therefore the successive approximations generated 
by Picard iteration are the partial sums of this power series, and they converge 
to the exact solution. 


The Picard procedure is especially important from a theoretical viewpoint. 
The method forms the basis of an existence proof for the solution to a general 
initial value problem; the idea is to show that there is a limit to the sequence 
of approximations, and that limit is the solution to the initial value problem. 
This topic is discussed in advanced texts on differential equations (e.g., see 
Waltman 1986, or Hirsch et al. 2004). Practically, however, Picard iteration is 
not useful for problems in science and engineering. There are other methods, 
based upon numerical algorithms and perturbation methods, that give highly 
accurate approximations with much less work. We introduce numerical methods 
in the next section. 

Finally, we point out that Picard iteration is guaranteed to converge if the 
right side of the differential equation f(t,x) is regular enough; specifically, the 
first partial derivatives of f must be continuous in an open rectangle of the 
tz plane containing the initial point. However, convergence is only guaranteed 
locally, in a small interval about to. 


[EXERCISES} 
1. Consider the initial value problem 
g =1+2", 2«(0)=0. 


Apply Picard iteration with x(t) = 0 and compute four terms. If the 
process continues, to what function will the resulting series converge? 
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2. Apply Picard iteration to the initial value problem 
e Ste. 20) S11, 


to obtain three Picard iterates, taking x(t) = 1. Plot each iterate and the 
exact solution on the same set of axes. 


3. Consider the initial value problem 2’ = —tx, x(1) = 2. 
a) Derive the exact solution x(t) = 2e@-*”)/2, 


b) Show that the integral equation formulation of the problem is 
t 
a(t) =2 -f sx(s)da. 
1 


c) Compute the first three Picard iterates, 71(t),...,73(¢). 


d) Plot the exact solution x(t) and x3(t) on the interval 1 <t < 2. 


6.2 Numerical Methods 


We emphasize again that most differential equations cannot be solved ana- 
lytically by a simple formula. In this section we develop a class of numerical 
methods that solve an initial value problem approximately using a computer 
algorithm. In industry and science, differential equations are almost always 
solved numerically because most real-world problems lead to models too com- 
plicated to solve analytically. And, in the rare case that the problem can be 
solved analytically, the solution is often in the form of a complicated integral 
or infinite series which must be resolved by a computer calculation anyway. We 
can never underestimate the importance and utility of numerical methods in 
science and technology. Many would say that the material in this brief section 
is the most important in the entire book. 

Any computer algebra system can easily implement the following numerical 
algorithms. We can either write a code (a program), or we can use the existing 
templates or built-in packages included in the software. Students can access 
these in MATLAB, Maple, Mathematica, R, and many other computer algebra 
systems. We do not use a specific computer algebra system in the main body of 
this text, but rather we include a brief summary in Appendix B of algorithms 
and specific commands in MATLAB. 
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6.2.1 The Euler Method 


We develop numerical approximations using a method called finite difference 
methods. Here is the basic idea. Suppose we want to solve the following initial 
value problem on the interval tp <t < T: 


xv =f(t,x), x(to) =o. (6.3) 


Rather than seek a continuous solution defined at each time t, we develop a 
strategy of discretizing the problem to determine numerical sequence of approx- 
imations Xo, X1, X2, X3,... at discrete times tg < ty < te < +++ < ty <-:: 
in the interval of interest. Therefore, the plan is to replace the continuous- 
time model (6.3) with an approximate discrete-time model that is amenable to 
computer solution. 

To this end, we divide the interval tp) < t < T into N small segments of 
constant length h, called the step size. Thus the stepsize is 

N 

This defines the set of equally spaced discrete times to, t1, ta, ...,tj = 7, where 
th = tot+tnh,n=0,1,2,...,N. Note that h = tr41 —tn. We develop a recursive 
formula that gives the approximation X,,41 at time t,+1 in terms of the previ- 


ous approximation X,, at time t,. Using this formula we can march successively 
to compute the desire approximate values Xo, Xi, X2, X3,...,Xwn. 

Let x = x(t) denote the exact solution to the initial value problem. Then 
x(t) = f(t, x(t)) for all t in [0,7]. We integrate this equation from ty to tr+1 
to get 


i oa | wT Seb eee. (6.4) 


The left side can be calculated by the fundamental theorem of calculus, and 
the right side can be approximated using the left-hand rule from calculus for 
estimating integrals. We get 


£(tn41) a Tite) = hf (tas @(hn)) Tr O(h’), 


where the error O(h?) denotes a term of order h?, meaning it is proportional 
to h?, the step size-squared. Rearranging, 


t(tn41) = t(tn) + hf (tn, (tn)) + O(h?). 


If we denote the approximation of x(t,) by X, and neglect the apparently 
small error term, then we can write 


Xn41 = Xn +hf(tn, Xn), n=0, 1, 2, 3,...N, (6.5) 
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which is the Euler method". To start the method at n = 0, we take Xp = 20, 
the initial condition. Then we use (6.5) to compute X1, X2, and so on. 

To summarize, equation (6.5) provides an algorithm for calculating approx- 
imations X1, X2, X3, and so on, recursively, at times t1, ta, ts,... . The discrete 
approximation consisting of the values Xo, X1, X2, X3,..., is called a numer- 
ical solution to the initial value problem. These discrete values approximate 
the graph of the exact solution, and often they are connected by line segments 
to obtain a continuous curve. 

The error term, O(h?), is called the local truncation error; it is the error 
introduced in replacing the integral by an approximation on one subinterval. 
We say the local truncation error is order h?, or second order. If we make an 
order h? error over one step, from t, to tn41, then the cumulative error, 
or global discretization error, taken over all N steps, from tp to ty, should 
be on the order N times O(h?), or O(h), since N = (T — to)/h. Therefore, 
applying the Euler method over a bounded interval should give a global error 
proportional to the step size h at the right endpoint. We say Euler’s method is 
order h, written O(h). 


Example 6.3 
Consider the initial value problem 
g=t—e, w(0y=1. 


We solve the equation numerically over the interval 0 < t < 2, taking N = 8 
steps; then the step size is h = (2 — 0)/8 = 0.25. Here f(t,v) = « —t and 
tr, = nh, n=0,1,2,...,8. The Euler equation (6.5) with step size h is 
Xn4i = Xn ao h(tn — Xn) 
= X, + h(nh— X,) 
= X,, + 0.25(0.25n — Xn). 


Beginning with Xo = 1 we have 
X, = Xo + (0.25)(0.25 -0 — Xo) = 1 + (0.25)(—1) = 0.75. 
Then 
X2 = X1 + (0.25)(0.25- 1 — X 1) = 0.75 + (0.25) (0.25 - 2 — 0.75) = 0.625. 


Continuing in this manner we generate the remaining approximations (to 3 
decimal places) 


X3 = 0.594, X, = 0.632,...,X7 = 1.017, Xs = 1.200. 


'® The method is named after the Swiss mathematician L. Euler (1707-1783). 
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We can connect the approximations by straight line segments to generate a 
continuous curve. 

In Figure 6.1 we show a numerical solution obtained in 3 cases, h = 
0.5, 0.25, h = 0.125, corresponding to N = 4, 8, 16 steps, respectively. We 
compare them to the exact solution on the interval [0,2], obtained by the inte- 
grating factor method: 

a(t) =t—1+2e~*. 


For each approximation, the table shows the value calculated at the endpoint 
t = 2 of the interval compared to the exact solution at that point. The error is 
the exact value minus the approximate value. Observe that the error is approx- 
imately halved as the step size h is halved, which is consistent with the fact 
that the cumulative error in the Euler method is order h. 


1.2002 | 0.0705 


Because it is tedious to do numerical calculations by hand, we can program a 
calculator or write a simple set of instructions for a computer algebra system to 
do the work for us. Most calculators and computer algebra systems have built-in 
programs that implement the Euler algorithm, as well as others, automatically. 
In Example 6.3, for illustration only, the smallest step size is h = 0.125, requir- 
ing 16 steps. But a typical step size in a real problem may be h = 0.001, or 
even smaller. Furthermore, in science and engineering we often write simple 
programs that implement recursive algorithms like the Euler method; that way 
we know the skeleton of our calculations, which is often preferred to plugging 
into an unknown black box containing a canned program. 

There is another insightful, geometrical way to understand the Euler algo- 
rithm using the slope field of the differential equation. Imagine we are at the 
position (t,, X,) and want to calculate the next value X,4+41. See (Figure 6.2). 
Draw the tangent line to the solution curve at (t,, X;,), which has equation 


ct Xn = f (tn; Xn)(t — by): 


This straight line is in the direction of the slope field at the point (t,,X,). Go 
along that line until you hit the vertical line t = t,41; the X value on that 
vertical line is X,41, which satisfies 


Xn4i = Xn = f (tas Xn)(tr41 — tn). 
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Figure 6.1 Three numerical solutions using the Euler method with h = 0.5, 
0.25, 0.125. They are compared to the exact solution. We expect the cumulative 
error at t = 2 to be order of the step size h. 


Because h = tn+1 — tn, the last equation is just Euler’s method. In summary, 
the Euler method computes approximate values by moving in the direction of 
the slope field at each approximate point. This explains why the the numerical 
solution in Example 6.3 (Figure 6.1) lags behind the exact solution, which is 
concave up. The Euler scheme is called an explicit method because it permits 
the calculation of X,,+1 directly from Xp. 


The Modified Euler Method 


The Euler algorithm is the simplest method for numerically approximating 
the solution to a differential equation. To obtain a more accurate method, we 
can approximate the integral on the right side of (6.4) by the trapezoidal rule, 
which is more accurate than the left-hand rule. Then 


U(tn41) — (tn) = SF(tn, w(tn)) + f(tn+1,2(tn+1))] + O(h*), 


where now the local truncation error is order h3. Then, discarding the error 
and letting X,, denote the approximation of x(t,), we obtain 


Kn = Xn + SUF tn Xn) + Hinta Xora) (6.6) 
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x 
slope field 


direction E ‘ 
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xX : -X = = 
n x xX I (ty Mt, t) 


Figure 6.2 The Euler method. Geometrically, if (¢,, X;,) is known, where X,, 
is the nth approximation, then the (n+ 1)st approximation X,,+1 is calculated 
by marching along the slope field from the point (t,, X,) to the line t = t,41. 


This difference equation is not as simple as it appears. It does not give the 
Xn+1 explicitly in terms of the X,, because the X,41 is tied up in a possi- 
bly nonlinear term on the right side. Such an equation is called an implicit 
equation. At each time step we have to solve a nonlinear algebraic equation 
for the X,,41. We can do this numerically, which is very time consuming. Does 
it pay off in more accuracy? The answer is yes. The Euler algorithm makes a 
cumulative error over an interval proportional to the step size h, whereas the 
implicit method makes a cumulative error of order h?. Observe that h? < h 
when / is small. 

A better approach which avoids having to solve a nonlinear algebraic equa- 
tion at each step is to replace the X,,41 on the right side of (6.6) by the Xn41 
calculated by the Euler method. That is, we compute a predictor 


and then use that to calculate a corrector 


h 
Xn41 = Xn “F 5 lf (tn, Xn) P f(tn41, Xn41))- (6.8) 


This algorithm is an example of a predictor—corrector method, and again 
the cumulative error is proportional to h?, an improvement to the Euler 
method. This is not insignificant; if h = 0.1 for example, then h? = 0.01. 
This method is called the modified Euler method, also referred to as the 
second-order Runge-Kutta method. 

The modified Euler method gives the new value X,,+11 as the average of two 
slopes: the slope at (t;,,X,) and the slope at aa his) 
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Example 6.4 


Consider the IVP 
a’ =—2te+vVt, x(0) =4. 


This initial value problem is linear and can be solved by integrating factors to 


obtain ; 
x(t) = et (1+ / vee"ds) . 
0 


We set up the modified Euler algorithm. The recursion is given by the predictor, 
Xnti = Xn th (-2tnXn + Vin) 5 


and the corrector 


h BS 
Xn4i = Xn + 2 [(-2tnXn + Vtn) + (—2tn41Xn41 + V tnt)| : 


Here, t, = nh and tyr41 = (n+ 1)h. Starting with tp = 0 and Xo = 4, we 
compute X), X2, X3,... recursively, in a loop, by these formulas. 


6.2.2 The Runge-Kutta Method 


The Euler and modified Euler methods are two of many numerical constructs to 
solve differential equations. Because solving differential equations is so impor- 
tant in science and engineering, and because real-world models are usually quite 
complicated, great efforts have gone into developing accurate efficient meth- 
ods. The most popular algorithm and workhorse of the subject is the highly 
accurate, explicit, fourth-order Runge-Kutta method, where the cumulative 
error over a bounded interval is proportional to h*. The Runge-Kutta update 


formula is h 
Xn41 = Xn + g (ht + 2ko + 2k3 + ka), 
where 
ky os f (tn, Xn), 
h h 
ko = flty t+ —,Xn+ =k), 
2= f( 9 + 5 1) 
h h 
k3 = th Zn sk ’ 
3 = f( 5 a 5 2) 
ka = f(tn +h, Xn + hks). 


We do not derive the formulas here, but we note that the new value is a weighted 
average of the four slopes ki,...,k4 taken at various points in the interval. The 
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only issue is that four function evaluations are required; but with current-day 
processor speeds that has become a moot point. The Runge-Kutta method is 
built-in on computer algebra systems and scientific calculators, and it is quite 
easy to program. 

Observe that the order of the error makes a huge difference in the accuracy. 
If the step h = 0.1, then the cumulative errors over an interval for the Euler, 
modified Euler, and Runge-Kutta methods are proportional to 0.1, 0.01, and 
0.0001, respectively. 


Error Analysis 


Readers who want a detailed account of the errors involved in numerical 
algorithms should consult a text on numerical analysis or on numerical solution 
of differential equations. Overall, there are three sources of errors in a finite 
difference scheme: truncation, the instability of the difference scheme itself, 
and roundoff error. We saw the source of the discretization, or truncation error, 
which arises from approximating a continuous problem by a discrete one. We 
have not discussed at all the issue of stability. Suffice it to say that the discrete 
algorithm itself may be unstable. That is, an error at the first step can be 
amplified significantly as it is propagated forward in time by the difference 
scheme. Finally, roundoff error is the error that a computer makes when it 
represents real numbers, for example, 7, by rational numbers. For example, if 
x(tn) is the exact solution at t,, we represent it with an approximation X, 
found from a difference formula. The error x(t,) — Xp is due to truncation. 
However, when we implement the algorithm on a computer, we compute actual 
numerical values X,,. The error Xp, — X,, is the roundoff error. Thus, the total 
error is 

t(tn) — Xn = (2(tn) — Xn) + (Xn — Xn), 


which is the sum of the truncation and the roundoff error. In this formula the 
numerical stability of the scheme is not considered. 

Finally, we comment that some differential equations are stiff in nature. 
That is, there are small intervals of time where the solution changes dramati- 
cally from one value to another. An example is a chemical reaction that goes 
slowly at the beginning but then goes to completion extremely rapidly. It should 
be clear that approximating the solution by simple slope fields cannot keep up 
with the rapid changes. Even the very accurate Runge-Kutta fails. Fortunately, 
stiff methods have been developed that accurately approximate these types of 
solutions. These methods are included in the codes in various software packages. 
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6.3 Systems of Equations 


The numerical methods introduced for a single equation easily extend to sys- 
tems of equations. We now catalog the results. Consider the two-dimensional 
system 


with initial conditions 
r(to)=20, y(to) = yo. 
We want to obtain a numerical solution on the interval tp) <t< T. 
The first step is to discretize the interval as before by defining the time 
steps by 
th =totnh, n=0,1,2,...,N, 
where h = (T —to)/N is the step size and N is the number of steps. Again, 


we use the notation X,, and Y,, to denote the approximate values of x(t,) and 
y(tn), respectively. We can summarize the methods as follows. 


Euler Method 


Xn41 = Xn + AE has hon Yn), 
Yne1 = Yn + hg(tn, Xn, Yn). 


Modified Euler method 


We first compute the predictors using the Euler method, 


Xn = X,+hf (tn, Xn; Yn); Yn41 =Y, +hg(tn,Xn,Yn), 


and then use those to calculate the correctors 


h 
Xn+1 = Xn a gf (tn, Xn, Y,,) oP f(tn41, Xn41; Yn+1)], 


h 
Ynt1 = Yn + 5 l9(tn, Xn, ae + g(tn41, Xn41; Yott is 
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Runge-Kutta method 


First we compute the values of the eight slopes: 


kay =f (igs Ma Ya) 
ko = g (tn, Xn, Yn) 

kia =f (tn + 8, Xn + Shi, Yn + $k21) 
koe => g (iy =i 2 Xn + 2kiu,Yn = 4ko1) 
kig = f (tn +4, Xn + pha, Yn + p22) 
ko3 = 9 (tn + 2 Xn + 2k12,Yn + Ako) 
kia = f (tn, Xn + hikes Ye + hikes) 


koa =g9 (tn, Xn, alt hkys3, Yn + hkg3) 


Then we compute the next approximation using weighted averages of these 
slopes, 


h 
Xn41 = Xn + ra (ki + 2ki2 + 2ki3 + kya), 


h 
Yoat = Yat ra (ko1 + 2ko2 + 2ko3 + koa). 


The global errors in these three methods do not change, and remain order h, 
h?, and h4, respectively. It should be clear that the same procedures can be 
extended to several equations in several unknowns. 

There are many ways to implement these algorithms in a variety of computer 
algebra systems. Many of the solutions and plots in the text were created with 
MATLAB. Appendix B contains a summary of important commands. Scientific 
calculators also implement the Euler and Runge-Kutta methods, but without 
the high quality graphics. 


EXERCISES 


1. (a) Use the Euler method and the modified Euler method to numerically 
solve the initial value problem 


ge =0.25¢—t7, 2«(0) =2, 


on the interval 0 < t < 2 using a step size h = 0.25. Compare them 
graphically, and compare the final values x(2) at the final ¢ = 2 value. (b) 
Perform calculations with h = 0.1, h = 0.01, and h = 0.001, and confirm 
that the cumulative error at t = 2 is roughly order h for the Euler method 
and order h? for the modified Euler method. 


2. Use the Euler method to solve the initial value problem x’ = x cost, x(0) = 
1 on the interval 0 < t < 20 with 50, 100, 200, and 400 steps. Compare 
with the exact solution and comment on the accuracy of the numerical 
algorithm. 
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3. A population of bacteria, given in millions of organisms, is governed by the 


law 
x 


vw! = 0.62 (1 2 cr} , 2«(0) =0.2, 


where in a periodically varying environment the carrying capacity is K(t) = 
10+ 0.9sint, and time is given in days. Plot the bacteria population for 
40 days. Use the Euler method. 


4. Consider the initial value problem on 0 < t < 5 given by 


dx Lda 28 
dt oS ee 


(a) Use the Euler method with h = 0.001 to approximate the solution. 
(b) Determine the validity of the approximation by finding the exact solu- 
tion. (c) Make the same calculation using the Runge-Kutta method. Is 
this approximation accurate? (d) Explain the findings or your numerical 
experiments. Hint: Examine the slope field. 


5. Suppose the temperature inside your winter home is 68 degrees at 2:00 P.M. 
and your furnace then fails. If the outside temperature has an hourly vari- 
ation over each day given by 15+ 10 cos(mt/12) degrees (where t = 0 repre- 
sents 2:00 P.M.), and you notice that by 10:00 P.M. the inside temperature 
is 57 degrees, what will be the temperature in your home the next morning 
at 6:00 A.M.? Sketch a plot showing the temperature inside your home and 
the outside air temperature. 


6. Consider the initial value problem x’ = 5a—6e~', x(0) = 1. Find the exact 
solution and plot it on the interval 0 < t < 3. Next use the Euler method 
with h = 0.1 to obtain a numerical solution. Explain the results of this 
numerical experiment. 


7. Consider the IVP 


which has the solution 99 


*t) = 799 — 908 
Thus, x(1) = 99. (a) Use the Euler method to approximate x(1) for step 
sizes h = 0.1, 0.05, 0.01, 0.005, 0.001, and 0.0005. Comment on its accu- 
racy. (b) Repeat the calculation using the modified Euler and the Runge— 
Kutta methods. What do you conclude? 


8. For the simple differential equation z’ = f(t), 2(0) = xo, show that the 
Runge-Kutta method reduces to Simpson’s rule for integration. 
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9. Numerically solve the initial value problem 


10. 


qd =-q—5e *sindt, gq(0)=1 


on the interval 0 < t < 3. Note: This is the RC circuit equation (R = 1, 
C = 1) with an oscillating, decaying emf; q = q(t) is the charge on the 
capacitor. 


(Resistive heating) Consider an RCL circuit where the resistance depends 
on temperature (a thermistor). Assume the resistor is a rectangular solid 
made of copper having length / and cross-sectional area A. Its resistance 
is R(T) = p(T)l/A, where p(T) is the resistivity, which depends on the 
temperature T via p(T’) = po(1+ aT), a > 0. Here, po is the resistivity at 
T = 0 degrees C. 


a) 


b) 


State why 


d2I dI I I 
Gp tholteN>+a=0, R= a 


: dt C A 


Show that Joule’s law, that is, the rate of change of thermal energy 
equals the rate of ohmic heating, is expressed by 


dT 
c}Al = Ro(l+eal)\P, 


where c is the specific heat of the resistor and 6 is its density. (For 
reference and extensions, see J. D. Logan, Int. J. Math. Sci. Tech. 
30(6), 1999.) 


Numerically calculate and plot the temperature of the resistor and the 
current in the circuit up to the melting point of the copper resistor, 1083 
deg. Let 1(0) = 0, Q(0) = Qo, T(0) = To denote the initial current, 
charge, and temperature of the resistor. Take L = 40(10)~® henrys, 
C = 56(10)~® farads, Qo = 10* coulombs, Ty = 20 deg, A = 107° m?, 
1 = 0.02 m, a = 0.004, c = 392.9 J/(kg- deg), 5 = 8890 kg/m?, po = 
1.63(10)~° ohm-m. 


A 


Review and Exercises 


This supplement begins with a brief review of first- and second-order equa- 
tions, including exercises and their solutions. This material corresponds to Sec- 
tion 3.7 of the 2nd edition of the text and the first two chapters of the current 
edition. 

The second part of this supplement features additional exercises correspond- 
ing to each chapter in the text. Many of the questions come from actual exam- 
inations, and they provide a problem bank for instructors and an opportunity 
for students to review and assess their skills. 


A.1 Review Material 


One way to think about learning and solving differential equations is in terms of 
pattern recognition. Although this is a compartmental way of thinking, it does 
help our learning process. When faced with a differential equation, what do we 
do? The first step is to recognize what type it is. It is like a pianist recognizing 
a certain sequence of notes in a complicated musical piece and then playing 
those notes easily because of repeated practice. In differential equations we 
practice identifying equations and learning solution techniques that solve those 
equations. 


e Antiderivatives. The simplest differential equation is 


x’ = g(t). 
© Springer International Publishers, Switzerland 2015 
J. D. Logan, A First Course in Differential Equations, Undergraduate Texts 
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The solution « = z(t) is the antiderivative of g(t), which we write as 
x(t) = f g(t)dt + C. Often we write the solution as an integral with a 
variable upper limit of integration, 


x(t) = | g(s)ds + C. 


Separable equations. A separable equation has the form 


& = a(t) f(a), 


where the right side is a product of functions of the dependent and inde- 
pendent variables. Immediately we separate variables and integrate to get 


lye” z [oare: 


Linear first-order equations. To solve a first order linear equation 
v' + p(t)x = q(t), 


multiply the equation by the integrating factor e/ ?4+ which reduces it to 
(ae! pteae) = q(t)e! PO", 
This reduced equation can be integrated immediately to get 


rel Pitdt / g(tjel 4a +. C, 


giving 


a(t) = e~ J pat (| atte! oar + c) ’ 


Bernoulli equations. The transformation y(t) = x(t)'~” reduces the 
Bernoulli equation 
x’ + p(t)x = q(t)a” 


to a linear equation for y = y(t). 


Homogeneous equations. An equation of the form 


rg (2% ) 
uae! ( t 
can be reduced to a separable equation using the change of variables y(t) = 


x(t) /t. 
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e Exact equations. The differential equation 
f(t,x) + g(t,z)x' =0 


is exact if f = g:. The solution is given by H(t,x2) = C where H is found 
by solving H; = f(t,a) and H, = g(t, x). 


e Autonomous equations. These equations have the form 
a’ = f(z), 


where the right side depends only on x. They may be solved by separa- 
tion of variables, but we commonly treat them using qualitative methods to 
understand the behavior of solutions. First we plot f(x) versus 7. The equi- 
libria are constant solutions satisfying f(x) = 0; the equilibria are points 
where f(a) crosses the x axis. Next we construct a phase line diagram by 
placing arrows on the x axis to denote the direction that x follows as t 
increases; where f(x) > 0 the arrows go to the right, and where f(x) < 0 
the arrows go to the left. This determines the stability of each equilib- 
rium. The analytic condition to guarantee stability at an equilibrium «”* is 
f'(a*) < 0. If f’(a*) > 0 the equilibrium is unstable, and if f’(2*) = 0 we 
have no information. 


e Second-order equations. There are two second-order linear equations 
that can be solved simply: equations with constant coefficients and Cauchy— 
Euler equations, 


ax" + ba’ + cx = 0, at?x” + bta’ + cx = 0. 


The former has solutions of the form x(t) = e*’, where \ satisfies the 
characteristic equation a\?+bA+c = 0, and the Cauchy—Euler equation has 
solutions of the form x = t”, where m satisfies the characteristic (indicial) 
equation am(m—1)+bm-+c = 0. For both equations we must distinguish 
cases when the roots of the characteristic equation are real and unequal, 
real and equal, or complex. In the complex root case we use Euler’s formula 
to obtain two real solutions. In each case we get two independent solutions 
and the general solution is a linear combination of those two solutions. 


e Nonhomogeneous equations. Nonhomogeneous equations have the form 
x" + p(t)x' + q(t)a = f(t). 
In all cases the variation of parameters formula applies to find the partic- 
ular solution: 


m= att) f Spare tay f eat 
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where 2; (t) and x(t) are basic solutions to the homogeneous problem, and 
W(t) = 2125 — 2x2 is the Wronskian. In the variable coefficient case it 
may not be possible to find two independent solutions of the homogeneous 
equation. (If we know one solution, the reduction of order method may 
lead to a second one.) For the constant coefficient case, a particular solu- 
tion can be more easily found using undetermined coefficients (judicious 
guessing) when f(t) is a polynomial, exponential, sine or cosine, or sums 
and products of those basic forms. The basic structure theorem holds for 
all linear nonhomogeneous equations: the general solution is the sum of the 
general solution to the homogeneous equation and a particular solution of 
the nonhomogeneous equation. 


e Conservation Laws. Equations involving Newton’s second law, 
me = i, 2) 


are usually handled by transforming the equation into to a system 2’ = y, 
y' =m 'F(a,y). If F = F(z), depending only on position, the equation is 
conservative and there is a potential function V(#) = — f F(«)dx. Then, 
dividing the two first order equations, x’ = y, y! = m~!F(a,y), and then 
integrating gives the conservation of energy law, 


sm +V(r)=E8, 
where the constant FE is the total energy in the system; E depends on the 
initial conditions and is found by substituting x = «(0) and y = y(0) into 
the conservation law. We can solve for the velocity y and plot velocity vs. 
position. Alternatively, we can replace y by dx/dt and separate variables 
to obtain « = x(t) in implicit integral form: 


: af d& 49 
=44/— ———— 0- 
2 xo j= V(E) 


1. Identify each of the differential equations and find the general solution. 
Some of the solutions may contain an integral. 


a) 2a” + 5a’ — 3a = 0. d) zc’ —6r =e'. 
b) x’ — Rx = 0, where R > 0. e) x” = —fe. 


c) 2’ =cost — xcost. f) 2” +62’ + 9% = 5sint. 
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g) 2 =—8t+6. l) ta’ +a = t?2? 

h) 2” +e =1— 242 m) a” = —32? 

i) a +a—-ta? =0. n) ta’ = a — 4 cos? (22). 

j) 2a” +2’ + 32 =0. 0) a” + 52” — 62’ = 9e*". 

kha (8 p) (6ta—2x3) = —(4r+3t?—3tx?)a’. 


2. Solve the initial value problem 2’ = x? cost, «(0) = 2, and find the interval 
of existence. 


3. Solve the initial value problem 2’ = —fr+t, a(1) = 2, and find the interval 
of existence. 


4. For all cases, find the equilibrium solutions for x’ = (a — a)(x? — a), where 


a is areal parameter, and determine their stability. Summarize the infor- 
mation on a bifurcation diagram. 


5. A spherical water droplet loses volume by evaporation at a rate propor- 
tional to its surface area. Find its radius r = r(t) in terms of the propor- 
tionality constant and its initial radius ro. 


6. A population is governed by the law 


= Ep 
e . Kk + ap 


where r, K, and a are positive constants. Find the equilibria and their 
stability. Describe, in words, the dynamics of the population. 


7. Use the variation of parameters method to find a particular solution to 
xv" — x! — 2x =cosht. 


8. Solve a’ = 4tx — 2n Ingw by making the substitution y = Ina. 


9. The equation (1 — ¢?)a” — 2ta’ + 2x2 = 0 has a solution x(t) = t. Find a 
second linearly independent solution of the form tw(t), for some function 
w. What is the general solution of the equation? 


@ Solutions to Review Exercises 
1. Describe the type of equation and solve. 


a) (Second-order linear) The characteristic equation is 2\? +5\ — 3 = 0 
with eigenvalues 1/2 and —2. The general solution is x(t) = cye’/? + 


coe 2, 
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b) 


c) 
d) 


o) 
Ww 


ae) 
“ 
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ar 
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~ 
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— 
wa 


eS 


° 
ae 
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(Decay equation) a(t) = Ce®*. 

(Separable) x(t) = 1— Ces™!. 

(First-order linear) The integrating factor is e~ 
—e'/5 + Ce®. 


. The solution is x(t) = 


(Cauchy—Euler) The indicial equation is m(m — 1) + 2 = 0, which 
has complex roots. The solution is «(t) = t~!/?(c1 cos[(V7/2) Int] + 


cg sin[(\/7/2) In¢]). 


(Second-order nonhomogeneous) ap, (t) = e~*4(c1 + cat). The particular 
solution takes the form z,(t) = Acost + Bsint. 


(Antiderivative) x(t) = —4t? + 6t + C. 


(Second-order nonhomogeneous ) The homogeneous solution is xp, (t) = 
c; cost+cg sint. A particular solution has the form x,(t) = At?+Bt+C. 


(Bernoulli) Make the substitution y = 1/2x?, y’ = —(2/2x?)x’ to trans- 
form it to a linear equation in y(t). 


(Second-order) The characteristic equation has roots —1/4 + iV 23/4. 
The solution is a(t) = e~*/4(c, cos V23t/4 + cz cos V23/, t/4). 


(Newton’s law) Make the substitution y = z’ to get the separable 
equation y’ = y?. This separates to give y = +1//C1 + 2t. Therefore, 
a(t) = f+1//C) + 2t dt + C2, which can be integrated to find z(t). 
(Hint: Make the substitution w = Cy + 2t, dw = 2dt.) 


(Bernoulli) Let y = 1/2, y’ = —1/x?z' to transform the equation into 
a linear equation for y(t). 


(Conservative equation) The potential energy is V(a) = x? and we have 
y?/2+ 23 = E. Letting y = 2’, separating variables, and integrating 
gives 


1 
t+C=+ / ————— dn. 
VE — 228 
(Homogeneous) Make the substitution y = 2/t to get the separable 
equation ty’ = —4 cos? 2y. Integrate to get — tan 2y = Int+ C, implic- 
itly. Now solve for y. 


(Third-order nonhomogeneous) The homogeneous solution is x(t) = 
c, + cge' + c3e~* and the particular solution takes the form x,(t) = 
Ae*", 


(Exact) Write the equation as (6ta — x°)dt + (4x + 3t? — 3ta?)dx = 0. 
The equation is exact. Therefore the solutions are H(t,x) = C where 


4 


6 


7 
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H, = 6tx — x3, H, = 4a + 3t? — 3ta?. Integrate the first equation 
with respect to t, obtaining an arbitrary function ¢(2); then take the 
x derivative of the expression to compare to the second equation. This 
determines the arbitrary function ¢(x) = 227. Finally we get H(t, x) = 
3t7x — ta? + 2x? = C. 


. The equation is separable and has the solution x(t) = 1/(0.5 — sint). This 
is valid as long as sint # 0.5. This give the range —7n/x <t< 7/6. 

. The equation is first order linear with integrating factor t+. The solution is 
x(t) = t?/6 + 11/6¢t*. This is valid on (0, +00). 

. The model is V’ = —k4rr?. Since V = 4rr3/3, we get V’ = 4nr?r’. Thus 
r’ = —k, giving r(t) = ro — kt. 


. The equilibria are p = 0 (unstable) and p = K (stable). Note p’ > 0 for 
0<p<Kandp'<0forp>K. 


. The solutions to the homogeneous equation are e’, e~*. The Wronskian is 
W(t) = —3e*. By the variation of parameters formula we have 
-t 2t 
e *cosht e*" cosht 
Zp(t) = —e* | ————dt +e * | ————dt 
oe ww we 


Replace cosht by (e’ + e~*)/2, simplify, and compute the integrals. 


. Let y = Ing. Then y’ = 2’/x and the differential equation becomes y/ + 
(2/t)y = 4t, which is linear with integrating factor t?. Its solution is y(t) = 
t? + C/t?. So x(t) = ev). 


. Substitute x = tw(t) into the differential equation to get (t — t?)w” + (2 — 
4t?)w’ = 0. Solve the equation to get a second solution 


The general solution is a linear combination of the the two independent 
solutions. 
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1 


mg Chapter 1 Exercises 


. Find the function x 


= x(t) that solves the initial value problem x’ = 
(Int+t?)/t, «2(1)=0. 
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2. 


10. 
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A particle of mass 2 moves in one dimension with acceleration given by 
3 — v(t), where v = v(t) is its velocity. If its initial velocity is v = 1, when, 
if ever, is the velocity equal to two? 


Find y(t) if 


Consider the autonomous equation 
dx 
— =~—(x —2)(# — 4). 
= ale = De = 4) 

Find the equilibrium solutions, sketch the phase line, and indicate the type 


of stability of each equilibrium solutions. 


Find the solution of the initial value problem 


2 
VD a 8, 
caren | (t+1), y(0) 


Find the (implicit) solution of the DE 


eR 
CS 
3ta? +t 


that passes through the point (1,1). 


A mass of m = 1 gm is subjected to a positive force proportional to the 
square root of the velocity; the initial velocity is 3 cm/sec. Find the velocity 
as a function of time and sketch a time series plot for t > 0. 


An RC circuit has R = 1, C = 2. Initially the voltage drop across the 
capacitor is 2 volts. For t > 0 the applied voltage (emf) in the circuit is 
b(t) volts. Write an IVP for the voltage across the capacitor and find a 
formula for it. 


Consider the autonomous equation 


P 
Lees (P —h)(P? —2P), A>. 
dt 
Clearly, P = h is an equilibrium. Use the derivative criterion to determine 


the values of h for which this equilibrium is unstable. 


A thermometer has been stored in a room whose temperature is 75 degrees. 
Five minutes after being taken outdoors it reads 65 degrees. After another 
five minutes it reads 60 degrees. What is the outdoor temperature? 


11. 


12. 


13. 


14. 


15. 


16. 


17. 


18. 
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Consider the differential equation 


dx 4 2 


a) In the ta plane sketch the set of points where the slope field is zero. 


b) Consider the initial value problem consisting of the differential equation 
and initial condition z(1) = 3. State precisely why you are guaranteed 
that the IVP has a unique solution in some small open interval con- 
taining t = 1. 


Consider the differential equation 


w' =a(1- =). 
t 


Plot the set of points in the tx plane where the slope field has value 1. You 
may use a calculator. 


Consider the model x’ = \?2 — x?, where \ is a parameter. Draw the 
bifurcation diagram (equilibria solutions versus the parameter) and deter- 
mine analytically the stability (stable or unstable) of the branch in the first 
quadrant. 


Find two different solutions of the differential equation 
Pr" — 122 =0 


having the form x(t) = t”. (That is, determine value(s) of m for which t” 
is a solution.) 


Find an explicit analytic formula for the solution to the initial value prob- 
lem 

dx 
dt => 2te-* x(0) te 


Solve the initial value problem 


dx 2 


A roasting chicken at room temperature (70 deg) is put in a 325 deg oven 
to cook. The heat loss coefficient for chicken meat is 0.4 per hour. Set up 
an initial value problem for the temperature T(t) of the chicken at time t. 
Set up only but do not solve. 


Consider a population model governed by the autonomous equation 


4p? 
‘= V2n— ; 
p= v2p 1+ p? 
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19. 


20. 


21. 
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a) Sketch a graph of the growth rate p’ versus the population p, and sketch 
the phase line. 


b) Find the equilibrium populations and determine their stability. 


Consider the initial value problem 


d 
(1 — ¢?)u2 + cost =0, u(1) = 10. 
Find the largest open interval of t-values on which this IVP is guaranteed 
to have a continuous solution. 


An RC circuit with no emf has an initial charge of go on the capacitor. The 
resistance is R = 1 and the capacitance is C = 1/2. Set up an initial value 
problem for the charge Q on the capacitor and solve it to find Q = Q(t). 


An autonomous differential equation is given by 


dy 


a =v? -Na-y)’, 


where a is a fixed constant with a > 6. 


a) Find all equilibrium solutions and draw the phase line diagram. Label 
all axes with “arrows” appropriately placed on the phase line. 


b) Draw an approximate graph of the solution curve y = y(t) when the 
initial condition is y(0) = 5. 


mg Chapter 2 Exercises 


Find the general solution to the equation x” + 32’ — 10x = 0. 


A mass of 2 kg is hung on a spring with stiffness (spring constant) k = 
3 N/m. After the system comes to equilibrium, the mass is pulled downward 
0.25 m and then given an initial velocity of 1 m/sec. What is the amplitude 
of the resulting oscillation? 


Find the general solution to the linear differential equation 
2 


1 
" ! — 
x a + Be = 0. 


Find the general solution x = x(t) of the damped spring—mass equation 
ee 6 
32 : 
Find the general solution x = x(t) to the differential equation 


Qt? x" + 5ta’ — 22 = 0. 


6. 


10. 


11. 


12. 


13. 


14. 
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Find the general solution y = y(t) to the 4th order differential equation 


yO — y = 38°. 


Find the general solution x = x(t) to the differential equation 


ta” +a! = At. 


For the equation 7” + 5x2 = 2tcos5t, what is the natural frequency? What 
is the form that the particular solution x,(t) takes? (Do not find the con- 
stants.) 


The solution of a second-order, linear, homogeneous equation is x(t) = 
5 + 2e—1%, What is the equation? 


Find the general solution of the fourth-order differential equation 


gl" ete 162°” — 0 


Find the general solution of the differential equation 


a? 4d 2 

dt? tdt  t? 
Consider a damped spring—mass system where x = x(t) is the displacement 
of the mass from equilibrium. Let m, c, and k denote the mass, damping 
constant, and spring constant, respectively. 


a) If there is no damping and there is a external forcing function of mag- 
nitude 3 cos 5t, what is the relationship between the mass m and spring 
constant & for which pure resonance occurs? 


b) If c = 2 and & = 0.1 and there is no external forcing, what values of 
the mass m will lead to damped oscillations? 


Find a particular solution to 


ve +a2=74+6e!. 


Transform the following nonlinear Bernoulli equation 


‘4 t 1 
x r= 
tx 
into a linear equation using a transformation of the dependent variable. 
DO NOT solve the linear equation. 
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15. An RCL circuit with no emf is governed by the circuit equation 
1 
LQ" + RQ! + 5Q=0, 
where Q = Q(t) is the charge on the capacitor. 


a) If the resistance is R = 8, shade the region in CL parameter space, or 
the CL plane (C is the horizontal axis, and L is the vertical) where 
the solution can be described as “oscillatory decay.” 


b) What is the decay rate? 


c) If R = 0, what is the natural frequency of oscillation of the circuit? 
What is its period? 


16. Show that the differential equation 2” +kx = f(t) has a particular solution 
1 re 
xp(t) = ah f(s) sin k(t — s)ds. 
0 


17. A function f satisfies the condition 2f’(¢) = f(1/t) for t > 0, with f(1) = 2. 
Letting x = f(t), show that x satisfies the equation t?x” + pta’ + qx = 0, 
for some constants p and q. Show that f(t) = Ct”, for some n. 


18. The equation tx” — x’ +(1—t)x = 0 has a solution of the form x = e”* for 
some m. Determine the value(s) of m and then find the general solution to 
the differential equation. 


mg Chapter 3 Exercises 


1. Find the Laplace transform of x(t) = e~°*h2(t) using the integral definition 
of Laplace transform. 


2. Find the inverse transform of 
1 
X(s) = G5. 
3. Use the convolution integral to solve the initial value problem 

ve’ +6x2= f(t), 2x(0) =2'(0) =0. 
(Write the correct integral form.) 
4. Solve the initial value problem 
a + We = 0a(t);. “e(O)\= 1, 


where 6,(t) is a unit impulse at some fixed time t = a > 0. Sketch a generic 
plot of the solution for t > 0. 
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5. Solve the IVP 
u’ + 3u = 69(t) + h(t), u(0) aa 


6. Find the inverse transformation of 


Ss 


AUS) eo ae) 


using convolution. Write the appropriate convolution integral, but do not 
calculate it. 


7. Solve the initial value problem using Laplace transforms: 


a’ +2r=e 'hs(t), x(0) =0. 


mg Chapter 4 Exercises 


1. Classify the type and stability of the equilibrium of the system 


gi =—-Qet+y, 
y = 22. 


In a phase plane, draw in the nullclines (as dashed lines) and indicate which 
is which. Then, noting the direction field along the x axis, sketch in a couple 
of sample orbits. 


2. Consider the two-dimensional linear system 


, f 1 12 
x=(, , )* 
a) Find the eigenvalues and corresponding eigenvectors and identify the 
type of equilibrium at the origin. 


b) Write the general solution. 


c) Draw a rough phase plane diagram, being sure to indicate the directions 
of the orbits. 


3. Use eigenvalue methods to find the general solution of the linear system 


4. Find the equation of the orbits in the xy plane for the system 2’ = 
Ady, y' =2x—2. 
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5. 


10. 


11. 
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For the following system, for which values of the constant b is the origin 
an unstable spiral? 


. Classify the equilibrium as to type and stability for the system 


ve =ax+13y, y =-2r-y. 


. A two-dimensional system xa’ = Ax has eigenpairs 


a(3) 4) 


a) Ifx(0) = ( : ) Senda dormila tory). Glee x)= ( : - ) 


b) Sketch a rough, but accurate, phase diagram. 


. Solve the initial value problem 


x’ = —2x + 2y, 
y' = 2a — By, 
x(0)=3, y(0)=—3. 


. Consider 


v=5xr—y, yl =—4a—-py. 


For which values of p is the origin a saddle point? 


In the zy phase plane, plot the orbit 


x(t) = Qe", 
y(t) =—-e-**, -00 <t<oo. 
For the the system 
a’ = —2xe +4y, 
y' = —5ax + 2y, 


sketch a few of the orbits in the phase plane. 
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12. The general solution of a linear system is 


(a) State the type and stability of the equilibrium (0,0), and then draw the 
linear orbits. (b) Draw on your diagram a few other key orbits, indicating 
exactly their behavior as they enter the origin. (c) Identify the eigenpairs 
of the linear system. 


mg Chapter 5 Exercises 
1. Find the solution z = x(t) of the differential equation 
/ 
ge 
t 
2. A conservative mechanical system is governed by Newton’s second law of 


motion (mass x acceleration = force): 


da 2 

dt? 
Find the potential energy V(x) of this system for which V(0) = 0. Then 
write the conservation of energy expression if «(0) = 0 and 2’(0) = 1. 
Finally, sketch the orbit passing through the point (0, 1). 


3. Consider the nonlinear system 


x! =2(1—2y), 
y =1—2?+cy. 
a) Find all the equilibrium solutions. 


b) In the zy plane plot the x and y nullclines. 


4. A particle of mass m = 1 moves on the z-axis under the influence of a 
potential V(x) = 2?(1— 2). 


a) Write Newton’s second law, which governs the motion of the particle. 


b) In the phase plane, find the equilibrium solutions. If one of the equi- 
libria is a center, find the type and stability of all the other equilibria. 


c) Draw the phase diagram. 
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Consider the nonlinear system 
g' =4r—22?-ay, y =y—y? —2Qxzy. 


Find all the equilibrium points and determine the type and stability of the 
equilibrium point (2,0). 


A particle with mass m = 2 moves in one dimension x under the influence 


of a potential function 
V(a) = a(x — 2). 


a) Find the force F' on the particle and write the equation of motion. 


b) If the initial velocity is y(0) = 0 and the total energy of the system is 
E =1, what is the initial position x(0)? 

c) Sketch the orbit of the particle in the xy phase plane. (Show its direc- 
tion). 

Consider the system 

ve =axy, y! =2y. 
Find a relation between x and y that must hold on the orbits in the phase 
plane. Sketch the orbits. 


Consider the system 
g =2Qy—a2, yi = cyt 227. 


Find the equilibrium solutions. Find and indicate the nullclines and equi- 
librium solutions on a phase diagram. Draw several interesting orbits. 


Show that the nonlinear system a2’ = y+ya?, y! = ry +2 has no periodic 
orbits. 


. Draw the phase diagram for the system 2x’ = x?y3, y! = —a3y?. 


. Show that the system x’ = —4x3(y — 2)?, y! = 2x4(2 — y) is a gradient 


system, and determine the type and stability of its critical points. 


. Show that the system x’ = 3y?— 32, y! = 3y — 3a? is a Hamiltonian 


system. Find the Hamiltonian and sketch the phase diagram. 
A basic chemostat, or chemical reactor, model has the form 
g Segee ee y =-ytb-r. a>1,b>1/(a—1), 
y 


where x is the concentration of bacteria in a tank and y is the nutrient 
in the tank; 6 is the constant rate that fresh nutrients are supplied to the 
tank at inflow rate q, and the perfectly stirred mixture is drawn off at the 
flow rate. Sketch the phase plane diagram indicating the dynamics of the 
system. 


B 


MATLAB® Supplement 


There is great diversity in differential equations courses with regard to use 
and choice of technology. For example, MATLAB®, Maple®, Mathematica®, 
and others, are all common computer environments used in colleges, universi- 
ties, and industry, and they perform both symbolic and numerical computa- 
tions. The same is true for advanced scientific calculators, but not at the scale 
or with the graphics capability of computer software. 

In this appendix we present a menu of useful commands in MATLAB for 
tasks commonly faced in differential equations. It is not meant to be an intro- 
duction or tutorial, but only a summary of the syntax and a few basic com- 
mands. The coding algorithms are simple enough that the reader can tran- 
scribe them into other systems, like Maple or Mathematica. MATLAB topics 
are listed in many sources on the internet, and they contain complete refer- 
ences with illustrations of all the commands. A good, in-hand reference text 
is Hunt et al. (2012). Readers should realize, however, that computer algebra 
systems are updated regularly and there is danger that some commands will 
quickly become obsolete as new versions appear. One the positive side, MAT- 
LAB code is very logical and similar to a pseudocode that may avoid some of 
the obsolescence. 

In MATLAB we can work in the command window, or we can write and save 
text files containing MATLAB commands, either as structured m-files or less 
structured scripts. On the next page we begin with a table of useful MATLAB 
commands. 


© Springer International Publishers, Switzerland 2015 
J. D. Logan, A First Course in Differential Equations, Undergraduate Texts 
in Mathematics, DOI 10.1007/978-3-319-17852-3 
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MATLAB Commands 


Command 

>> 

% 

Ctrl+C 

help topic 
a=4,bl=5 
clear a bl 

clear all 

x=[0, 3, 6, 9, 12, 15, 18] 
x=0:3:18 
x=linspace(0,18,7) 


x 
+-*/A 
sqrt(a) 


ap 

t=0:0.01:5, x=cos(t), plot(t,x) 
xlabel(’time’), ylabel(’state’) 
title(’Title of Plot’) 

xlim([a b]), ylim([c d]) 

hold on; hold off 

for n=1:N,...,end 

plot(x) 


A=[1 2; 3 4] 


x=A\b 

inv(A) 

AN’ 

det (A) 

[V, D] = eig(A) 

quad(’fun’, a, b, tol); 
function fun=f(t), fun=t.A 2 
f=Q(t,x) t*x—sin(t) 
ezplot(’2*x*sin(x)’, [—2,4]) 


Instruction 

command line prompt 

semicolon suppresses output 

for a comment; statements after % are ignored 
terminate a program 

help on MATLAB topic 

assigns 4 to a and 5 to bl 

clears assignments for a and bl 

clears all the variable assignments 

row vector (list) assignment 

defines the same vector as above 

defines the same vector as above 

transpose of a row list x 

common operations with numbers 

square root of a 

e* and Ina 

the number 7 

operations on vectors of same length (with dot) 
plots cost on 0 < t < 5 with spacing 0.01 
labels horizontal and vertical axes 

titles the plot 

sets plot ranges on x and y axes 

does not plot immediately; releases hold on 
syntax for a “for-end” loop for n from 1 to N 
plots a line graph of a vector x 

1 2 

-. 


solves Ax=b, where b=[q; §] is a column vector 


defines a matrix ( 


the inverse matrix 

transpose of a matrix 

determinant of A 

computes eigenvectors and eigenvalues of A 
Approximates f?fun(t)dt, tol= error tolerance 
defines f(x) = ¢? in an m-file 

defines a symbolic function f(t, x) = ta — sin(t) 
plots f(a) = 2usin(#) on -2<a<4 
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The remaining portion of the appendix contains the following topics: 


e Scripts or m-files of programs (codes) for solving differential equations: the 
Euler method, modified Euler method, and the Runge-Kutta method 


e Using MATLAB’s built-in programs to solve differential equations 
e Symbolic commands to solve differential equations 


e Other common utilities and examples 


B.1 Coding Algorithms for Differential 
Equations 


Below are three programs, or codes, in MATLAB for the Euler method, the 
improved Euler method, and the Runge-Kutta method. The first two codes 
are scripts that define the right side of the differential equation by a function 
handle. They may be saved with the .m extension and run as needed. As an 
example, we solve a Newton’s law of cooling problem 


t 
x’ = —0.1 (<- (15+ 120057) ) , 2(0) =68, O0<t< 72. 


The plot is shown in Figure B.1. 
@ The Euler Method 


f=@(t,x) -0.1*(x-(15+12*cos(pi*t/12))); 

t0=0; x0O=68; T=72; N=1000; h=(T-t0)/N; x=zeros(N+1); x(1)=x0; 
for n=1:N 

t(n) = t0+(n-1)*h; 

x(n+1) = x(n)+h*f(t(n),x(n)); 

end 

t=t0:h:T; plot(t,x) 


%Labels can be added to the plot as follows: 


xlabel('time in hours’), ylabel(’temperature in deg F’) 
ylim([O 70]), title(’Newton Law of Cooling’) 
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Figure B.1 The solution of «’ = —0.1(a — (15 + 12 cos(at/12))), x(0) = 68, 
which is Newton’s law of cooling. This is solved by the Euler (shown), modified 
Euler, and Runge-Kutta methods. 


B® The Modified Euler Method 


f=@(t,x) -0.1*(x-(15+12*cos(3.14*t/12))); 

t0=0; x0O=68; T=72; N=1000; h=(T-t0)/N; x=zeros(N+1); 
x(1)=x0; t=t0:h:T; 

for n=1:N 

x(n-1) = x(n)+(h/2)*(F(t(n).x(n))-+F(¢(n-+1).x(n) +h*f(t(n).x(n)))); 
end 

t=t0:h:T; plot(t,x) 


@ The Runge-Kutta Method 


In this code we define the differential equation in a function file at end, instead 
of using a function handle as in the last two codes. The calling code must also 
be a function file, here function RungeKutta. 


function RungeKutta 

t0=0; x0=68; T=72; N=20; h=(T-t0)/N; 

x=zeros(1,N+1); x(1)=x0; 

for n=1:N 

t(n)=t0+(n-1)*h; 

k1l=f(t(n),x(n)); k2=f(t(n)-+-0.5*h,x(n)+0.5*h*k1); 
k3=f(t(n)+0.5*h,x(n)+0.5*h*k2); k4=f(t(n)-+h,x(n)+h*k3); 
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x(n+1)=x(n)+(h/6)*(k1+2*k2+2*k3+k4); 
end 

time=t0:h:T; plot(time,x) 

xlabel('time t’), ylabel(‘state x’) 


function dx=f(t,x) 
dx=-0.1*(x-(15+12*cos(3.14*t/12))): 


#@ Two-Dimensional Runge-Kutta Method 
The following m-file solves the system of two linear differential equations 
xv =—-2.92—4.3y, y' =0.2l2—0.78y, 0<t< 10, 


with initial conditions (0) = 5, y(0) = 0. N is the number of steps and h is 
the stepsize. Here, two figures are produced, the time series plot and a phase 
plane plot. The right sides of the differential equations are defined by function 
handles. 


t0=0; x0=5; yO=0; T=10; N=1000; h=(T—t0)/N; 
x=zeros(N+1); y=zeros(N-+1); 

x(1)=x0; y(1)=y0; 

f=@(t,x,y) -2.9*x-4.3*y; g=@(t,x,y) 0.21*x—0.78*y; 
for n=1:N 

t(n)=t0+(n-1)*h; 

k11=(t(n),x(n),y(n)); k21=g(t(n).x(n),y(n)) 
k12=f(t(n)-+0.5*h,x(n)+0.5*h*k11,y(n)+0.5*h*k21); 
k22=e(t(n)+0.5*h,x(n)+0.5*h*k11,y(n)-+0.5*h*k21): 
k13=f(t(n)-+0.5*h,x(n)+0.5*h*k12,y(n)+0.5*h*k22); 
k23=¢(t(n)+0.5*h,x(n)+0.5*h*k12,y(n)-+0.5*h*k22): 
k14=f(t(n),x(n)+h*k13,y(n)-+h*k23); 
k24=g(t(n),x(n)-++h*k13,y(n)+h*k23); 
x(n-+1)=x(n)+(h/6)*(k11+2*k12+2*k13+k14); 
y(n-+1)=y(n)+(h/6)*(k21+2*k22-+2*k23-+k24): 

end 

figure(1) 

tau=t0:h:T; plot(tau,x,'r’,tau,y,'g’,tau,0) 
xlabel('time’), ylabel(’x, y’), title(’Time Series’) 
legend(’x’,'y’) 

figure(2) 

tau=t0:h:T; plot(x,y), xlabel(’x’), ylabel('y’), title(’Phase Plane’) 


)= 
)= 
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B.2 MATLAB’s Built-in ODE Solvers 


MATLAB contains several built-in solvers that numerically compute the solu- 
tion to an initial value problem. To use these routines we can define both the 
differential equation and the calling routine in function files, or we can define 
the differential equation symbolically using a function handle. The files below 
use the package ode45, which is a Runge-Kutta type solver. 


H@ Single Equation 
Consider the initial value problem 
ge = 2e(1 —0.30)+cos4é, 0<¢< 3, x(0) =0.1. 


%The calling file is defined as follows: 

function diffeq 

trange = [0 3]; ic=0.1; 

[t, x] =ode45(@dx,trange,ic); 

plot(t,x,’*-’) 

%The differential equation is defined as follows: 
function dx = f(t,x) 

dx = 2*x.*(1-0.3*x)+cos(4*t); 


@ Second-Order Equations and Systems 
Consider the famous van der Pol equation 
x" + a(x? —1)2' +2 =0, 


where a is a positive parameter. We convert it to a system in the usual way: 


gi =y, yi =a(l—a)y—z. 

Take initial conditions 7(0) = 2, y(0) = 0. Two plots, the time series (Fig- 
ure B.2) and the phase plane (Figure B.3), are shown. The reader is urged to 
run the same program for other values of a, say, a = 1000. In this latter case 
the equation is stiff, meaning there are very rapid changes in x and y over a 
small time interval. A Runge-Kutta method may be inadequate for this case, 
and we can use a stiff solver, one of which in MATLAB is ODE15s. 


function vanderpoleqn 

yO=[2;0]; tspan=[0,20]; a=1; 
[t,y]=ode45(@vanderpol, tspan, yO); 
figure(1) 

plot(t,y(:,1)), xlabel('t’), ylabel(’solution y’) 
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title(’van der Pol Equation, a=1’) 
figure(2) 

plot(y(:,1),y(:,2)), xlabel(’x’), ylabel(‘y’) 
function dy=vanderpol(t,y) 

a=1; 
dy=ly(2):*(1-y(1)*¥(1))*v(2)-v(U)I: 


van der Pol Equation, a = 1 


solution y 
o 


Figure B.2 The solution x = x(t) of the second-order the van der Pol equa- 
tion when a = 1. 


Figure B.3 The corresponding phase plane orbit, which is periodic, for the 
van der Pol equation when a = 1. It can be shown that that this solution is a 
limit cycle. 
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@ The Duffing Equation 
The Duffing equation 
"Ie! 4+ ka + Bx® = Acosuwt, 


an important and famous nonlinear, forced oscillator equation. 7 is the damping 
constant, & the stiffness, 6 the nonlinear effect, A the amplitude, and w the 
forcing frequency. It has extraordinary properties, depending on the values of 
the parameters.! In the following code, we use the solver ode23s, which is a 
stiff solver that can adapt to rapid changes in x over short time intervals. We 
take y= k= 6=1 and A=0.8, w = 3. See Figure B.4. 


function DuffingEq 

[T ,X]=ode23s(@f,[0 1000], [1 0]); 
subplot(1,2,1), plot(X(:,1),X(:,2)) 
subplot(1,2,2), plot(T,X(:,1)) 

function dx=f(t,x) 

dx=[x(2); -x(2)-x(1)-x(1)A3+0.8*cos(3*t)]; 
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Figure B.4 Numerical solution of the Duffing equation: (Left) The orbit in 
the xy phase plane, and (Right) the time series = x(t). The initial condition 
is (0) = 1, y(0) =0. 


' For example, see the Wikipedia article at http://en.wikipedia.org/wiki/Duffing 
equation. 
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B.3 Symbolic Solutions Using dsolve 


The following script symbolically solves the logistic equation y’ = ry(1— 
y/IK), y(0) = yo and plots the solution using dsolve. The command vectorize 
turns a symbolic solution into a vector solution that MATLAB can evaluate 
and plot. (The plot is not shown.) 


y=dsolve(’Dy=r*y*(1-(1/K)*y)’,'y(0)=y0’); 
y=vectorize(y); 

r=0.5; K=150; yO=15; t=0:.05:20; y=eval(y); 
plot(t,y), ylim([0 K+10]), title(’Logistic Growth’) 
xlabel('time (years)'), ylabel(’Population’) 


Solve and plot a symbolic solution of x’ = tz?, x(—2) = 1 using dsolve and 
ezplot. 


sol = dsolve(’Dx=t*xA2’,’x(-2)=1','t’); 
ezplot(sol, [-2,2]) 


Next we solve and plot the solution to an initial value problem, 
g' = tx”, w(—2)=1, -2<t<2, 
using ode45 and a function handle: 


f=@(t,x) t*xA2; 
[T ,X]=ode45(f,[-2,2],1); 
plot(T,X) 


x=dsolve('25*D2x+10*Dx+226*x=901*cos(3*t)',’x(0)=0, Dx(0)=0'); 
x=simple(x) 
ezplot(x,[0,6*pi]) 


Solve the system, 2’ = ra+4y, y’ = 4x — 3y, using dsolve: 


[x,y] = dsolve('Dx=r*x+4*y, Dy =4*x-3*y’, 'x(0) = a, y(0) = b’); 
x=vectorize(x), y=vectorize(y); 

a=1; b=3; r=1; t=1:0.01:2; 

x=eval(x); y=eval(y); 

plot(t,x,t,y) 
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B.4 Other Routines 


H@ Plotting Antiderivatives 


Calculate and plot the antiderivative, or function with a variable upper 


limit: ‘ 
u(t) =} e” dx. 
0 


x=0:0.1:5; u=exp(-x.A2); 
vals=cumtrapz(x,u); 
t=x; plot(t,vals) 
xlabel(‘time '), ylabel(’u(t)’) 

@ Slope and Direction Field 
To plot the slope field (Figure B.5) of the equation 

x =t+sina, 

in the region —3 < t < 3, —2 < a < 2, use the commands: 
[t,x]=meshgrid(-3:.3:3,-2:.3:2); 
dx = t+sin(x); dt = ones(size(dx)); 
dxu = dx. /sqrt(dt.A2+dx.A2); 


dtu = dt. /sqrt(dt.A2+dx.A2); 
quiver(t,x,dtu,dxu) 


To plot the direction field of the system 
v=2(8—4z—-y), y' =y(3—3r—-y) 


in the region 0 < « < 3,0 < y < 4, we again use the quiver command. 
Direction fields have both direction and length, but usually we are interested 
only in directions; therefore, each vector is divided by its length (making it unit 
length), and then multiplying by 0.5. The figure is not shown. 


[x,y] = meshgrid(0:0.3:3, 0:0.4:4); 

dx = x.*(8-4*x-y); dy = y.*(3-3*x-y); 
dux=dx./sqrt(dx.A2+dy.A2); duy=dy. /sqrt(dx.A2+dy.A2); 
quiver(x,y,dux,duy,0.5) 


H@ Roots of a Polynomial 


Solving higher order linear equations requires finding roots of the characteristic 
equation. If the characteristic equation is a cubic equation a\?+bA?+cA+d = 0, 
then the roots are found by the command roots([a b c d]). For example, if 
A? — 34? + 1 = 0 then roots({1 -3 0 1]) returns the roots —0.53, 0.65, 2.88. 
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Figure B.5 Slope field diagram for the equation x’ =t+sinz. 


B.5 Examples 


e Plotting Commands. Define a function f(t) = cos(t)t by: f = @(t) 
cos(t)*t. 


To evaluate the f at given t-value: f(0.5). 

To plot the graph of f over an interval: ezplot(f,[0,20]) 

To find a zero of the function near an initial guess: fzero(f, 2) 

To define a function of several variables: F = @(x,y) xA4 + yA4 

To evaluate the function for given values of x, y: F(1,2) 

To graph F'(a,y) over a rectangle in the x,y plane: ezsurf(F,[-2,2,-2,2]) 
Numerical Solution. Solve the initial value problem x’ = ta”, x(—2) = 1, 


and plot the solution over the interval [—2, 2]. 


f = @(t,x) t*xA2 
[ts,xs] = ode45(f,[-2,2],1); 
plot(ts,xs) 


To plot several solution curves use the commands hold on and hold off. 
After obtaining the first plot type hold on, then all subsequent commands 
plot in the same window. After the last plot command type hold off. For 
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example (see Figure B.6), plot the direction field and the 13 solution curves 
with the initial conditions z(—2) = —0.4, —0.2,...,1.8, 2: 


for x0=-0.4:0.2:2 

[ts,xs] = ode45(f,[-2,2],x0); plot(ts,xs), hold on 
end 

hold off 


Figure B.6 Plots of several integral curves of the differential equation 2’ = 


ta. 


e Symbolic Solution. To solve a differential equation symbolically enter 
sol = dsolve(’Dx=t*xA2’,'t’). 


When MATLAB cannot find a solution it returns an empty symbol. If it 
finds several solutions it returns a vector of solutions. Here there are two 
solutions and MATLAB returns a vector sol with two components: sol(1) 
is 0 and sol(2) is -1/(tA2/2 + C1) with an arbitrary constant Cl. You can 
substitute values for the constant using subs(sol,’C1’,value). For example, 
to set C1 in sol(2) to 5 use subs(sol(2),’C1’,5). You can simplify the solution 
using simple(sol). 


To solve an initial value problem specify an initial condition: 
sol = dsolve(’Dx=t*xA2’,’x(-2)=-4’,'t’) 


To plot the solution use ezplot(sol,[t0,t1]). For example (Figure B.7): 
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sol = dsolve(’Dx=t*x/A2’,’x(-2)=-0.4','t’) 
ezplot( sol , [-2 2]) 


To obtain numerical values at one or more ¢ values use subs(sol,’t’,tval). 


-2 7 0 1 2 
Figure B.7 The solution to x’ = ta”, 2(—2) = —0.4 


e Solution of a system. Consider the system 


yl! = y2, 
y2’ = —sin(y1) + sin(5t) 


with the initial conditions y1(0) = 1, y2(0) = 0, which models a forced 
pendulum. Here yl and y2 are the states, instead of the usual x and y 
because of ease of coding in MATLAB. 


First we define the right sides of the differential equation as a vector func- 
tion (handle), 


f = @(ty) [y(2); -sin(y(1))+sin(5*t)] 


To plot the solution over the range 0 < t < 20 with initial values [1;0] we 
enter 


[ts,ys] = ode45(f,[0,20],[1;0]); plot(ts,ys) 


Type plot(ts,ys(:,1)) to plot only y1(¢). 


To plot orbits in the phase plane (Figure B.8) enter 
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plot(ys(:,1),ys(:,2)) 


1.5 — OO 


-1.5 -1 -0.5 0 0.5 1 1.5 


Figure B.8 Phase plane plot of the solution to yl’ = y2, y2/ = —sin(yl) + 
sin(5t), y1(0) = 1, y2(0) =0. 


e Using dsolve. To obtain a symbolic solutions we use the dsolve command. 
For the second-order equation 


i 


y” = —y + sin(5t), 

enter 
sol = dsolve('D2y = -y + sin(5*t)',’t’) 

If you want to simplify the answer enter 
s = simple(sol) 

To solve the equation with initial conditions y(0) = 1, y’(0) = 0 use 
sol = dsolve(’D2y = -y + sin(5*t)’,’y(0)=1',’Dy(0)=0','t’) 


Then use s = simple(sol) to simplify, if needed. To plot the solution curve 
(see Figure B.9) use ezplot: 


ezplot(sol, [0,20]) 
The dsolve command gives the output 


sol = 
yl: [1x1 sym] 
y2: [1x1 sym] 
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0.5 


Figure B.9 solution to y” = —y+sint, y(0) = 1, y/(0) =0. 


which means that the two components of the solution can be found by 
entering sol.y1 and sol.y2. We can always simplify using, for example, s2 = 
simple(sol.y2). 


To plot the solution curves use ezplot: 


ezplot(sol.y1, [0,20]) 
hold on 
ezplot(sol.y2, [0,20]) 
hold off 
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